2024-09-17T04:13:25.152 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T04:13:25.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:13:25.255 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/acls} email: pdonnell@redhat.com first_in_suite: false job_id: '7908525' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Reduced data availability - Degraded data redundancy sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXDY8ssJDh63fpIN0T3XhnVurPCalWG0on22dG9zadg0Zzkhb1D20nQOMIlSdGjQZMXMldQmWdo0cBJrpscrMA= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeS96gwWxnrkMwk3ych3pRTvxUqb6POx9WIa0EcVkdd1q2T4dPTFSAcCc8WKMiL4uA/zhCJiMkISCN7pOms6bQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T04:13:25.255 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T04:13:25.256 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T04:13:25.256 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T04:13:25.258 INFO:teuthology.task.internal:Checking packages... 2024-09-17T04:13:25.279 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T04:13:25.279 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T04:13:25.279 INFO:teuthology.packaging:ref: None 2024-09-17T04:13:25.279 INFO:teuthology.packaging:tag: None 2024-09-17T04:13:25.279 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:13:25.279 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:13:25.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T04:13:25.423 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T04:13:25.425 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T04:13:25.431 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T04:13:25.431 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T04:13:25.438 INFO:teuthology.task.internal:Saving configuration 2024-09-17T04:13:25.455 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T04:13:25.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T04:13:25.480 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 04:08:25.195476', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXDY8ssJDh63fpIN0T3XhnVurPCalWG0on22dG9zadg0Zzkhb1D20nQOMIlSdGjQZMXMldQmWdo0cBJrpscrMA='} 2024-09-17T04:13:25.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 04:08:25.196828', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeS96gwWxnrkMwk3ych3pRTvxUqb6POx9WIa0EcVkdd1q2T4dPTFSAcCc8WKMiL4uA/zhCJiMkISCN7pOms6bQ='} 2024-09-17T04:13:25.500 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T04:13:25.506 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T04:13:25.506 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T04:13:25.506 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T04:13:25.556 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe998833ac0>, signals=[15]) 2024-09-17T04:13:25.557 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T04:13:25.562 INFO:teuthology.task.internal:Opening connections... 2024-09-17T04:13:25.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:13:25.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:13:25.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:13:25.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:13:25.717 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T04:13:25.723 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-17T04:13:25.741 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-17T04:13:25.741 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-17T04:13:25.798 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:13:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:13:25.800 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:13:25.800 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-17T04:13:25.819 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-17T04:13:25.838 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-17T04:13:25.838 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-17T04:13:25.896 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-09-17T04:13:25.896 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-09-17T04:13:25.896 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-09-17T04:13:25.896 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-09-17T04:13:25.896 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T04:13:25.897 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T04:13:25.897 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-17T04:13:25.919 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T04:13:25.928 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T04:13:25.938 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T04:13:25.938 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:13:25.940 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-17T04:13:25.957 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T04:13:25.963 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T04:13:25.964 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:13:25.998 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-17T04:13:26.024 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T04:13:26.078 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T04:13:26.091 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T04:13:26.092 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T04:13:26.092 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T04:13:26.092 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:13:26.093 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T04:13:26.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:13:26.109 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-17T04:13:26.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:13:26.112 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-17T04:13:26.166 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-17T04:13:26.167 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-17T04:13:26.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-17T04:13:26.169 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-503.el9.x86_64 2024-09-17T04:13:26.169 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.14.0-503.el9.x86_64 2024-09-17T04:13:26.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-09-17T04:13:29.098 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.3 MB 00:01 2024-09-17T04:13:32.460 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.3 MB 00:04 2024-09-17T04:13:32.679 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 20 MB 00:02 2024-09-17T04:13:34.353 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-17T04:13:37.213 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-17T04:13:38.697 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-17T04:13:40.009 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-17T04:13:40.812 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-17T04:13:42.571 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-17T04:13:43.641 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T04:13:45.732 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T04:13:47.713 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:13:47.713 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:13:47.827 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-17T04:13:47.833 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:13:47.834 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-17T04:13:47.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:13:47.835 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-17T04:13:47.835 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-17T04:13:47.835 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-17T04:13:48.175 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 434 kB/s | 36 kB 00:00 2024-09-17T04:13:49.089 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T04:13:51.021 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T04:13:51.021 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T04:13:51.124 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-17T04:13:51.133 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-09-17T04:13:51.134 INFO:teuthology.orchestra.run.smithi112.stdout:Install 4 Packages 2024-09-17T04:13:51.134 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:13:51.134 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 79 M 2024-09-17T04:13:51.134 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 126 M 2024-09-17T04:13:51.134 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-17T04:13:51.442 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.444 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.444 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.540 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.546 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.551 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:51.925 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-17T04:13:52.132 INFO:teuthology.orchestra.run.smithi112.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 48 kB/s | 36 kB 00:00 2024-09-17T04:13:52.162 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:52.195 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 216.31.2.234) 2024-09-17T04:13:52.267 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 7.0 MB/s | 29 MB 00:04 2024-09-17T04:13:52.933 INFO:teuthology.orchestra.run.smithi112.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-17T04:13:53.075 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.9 MB/s | 35 MB 00:04 2024-09-17T04:13:53.075 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:13:53.075 INFO:teuthology.orchestra.run.smithi063.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-17T04:13:53.633 INFO:teuthology.orchestra.run.smithi112.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-17T04:13:53.786 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-17T04:13:54.153 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-17T04:13:54.153 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-17T04:13:54.416 INFO:teuthology.orchestra.run.smithi112.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-17T04:13:54.420 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:13:54.420 INFO:teuthology.orchestra.run.smithi112.stdout:Total 24 MB/s | 79 MB 00:03 2024-09-17T04:13:55.108 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-17T04:13:55.137 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-17T04:13:55.138 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-17T04:13:55.457 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-17T04:13:55.457 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-17T04:13:56.423 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-17T04:13:56.424 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-17T04:13:57.721 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-17T04:13:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:13:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:13:58.847 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-17T04:13:59.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:13:59.642 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:14:01.202 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:14:01.338 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:02.412 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:14:02.546 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:07.412 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:07.447 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.429 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.470 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.575 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.778 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.778 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:14:50.778 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:14:50.778 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:50.851 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:50.851 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T04:14:50.851 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T04:14:50.851 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:14:51.620 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-17T04:14:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T04:14:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:14:51.671 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-17T04:14:51.671 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T04:14:51.672 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:14:51.672 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-17T04:14:51.953 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:14:52.025 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:14:52.037 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:52.038 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.038 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.039 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:14:52.039 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:14:52.039 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T04:14:52.039 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:14:52.039 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:14:52.097 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:52.098 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-17T04:14:52.113 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:52.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.114 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.114 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T04:14:52.114 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T04:14:52.114 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T04:14:52.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T04:14:52.114 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T04:14:52.134 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-17T04:14:52.134 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-17T04:14:52.134 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:14:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:14:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:14:52.137 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:14:52.137 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:14:52.172 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T04:14:52.173 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-09-17T04:14:52.204 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.06 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 82.el9 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Group : Unspecified 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 8274670 2024-09-17T04:14:52.205 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : builder@centos.org 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-09-17T04:14:52.206 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:14:52.207 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T04:14:52.207 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T04:14:52.207 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 5.14.0-508.el9.x86_64 2024-09-17T04:14:52.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T04:14:52.819 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-17T04:14:52.821 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-17T04:14:54.047 INFO:teuthology.orchestra.run.smithi112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:14:54.081 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-17T04:14:54.083 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-17T04:14:54.098 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.Tg6cUcyLby 2024-09-17T04:14:54.098 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Tg6cUcyLby 2024-09-17T04:14:54.174 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.Tg6cUcyLby 2024-09-17T04:14:54.259 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T04:14:54.284 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-17T04:14:54.290 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T04:14:54.316 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.Tg6cUcyLby is 6KB 2024-09-17T04:14:54.345 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.HC7Vr6hV4p 2024-09-17T04:14:54.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HC7Vr6hV4p 2024-09-17T04:14:54.364 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.Tg6cUcyLby 2024-09-17T04:14:54.379 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:14:54.411 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.HC7Vr6hV4p 2024-09-17T04:14:54.442 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:14:54.442 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:14:54.442 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:14:54.442 INFO:teuthology.orchestra.run.smithi112.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:14:54.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:14:54.541 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.HC7Vr6hV4p is 6KB 2024-09-17T04:14:54.561 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.HC7Vr6hV4p 2024-09-17T04:14:54.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T04:14:54.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-17T04:14:54.638 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T04:14:54.638 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T04:14:54.638 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T04:14:54.638 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T04:14:54.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T04:14:54.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-17T04:15:24.629 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T04:15:24.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:15:24.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:15:24.920 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T04:15:24.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:15:24.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:15:43.165 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-17T04:15:43.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T04:15:52.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:15:52.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:15:52.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:15:52.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:15:55.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-17T04:15:55.489 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T04:16:07.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:16:07.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:16:07.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:16:07.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:16:25.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-17T04:16:25.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-17T04:16:40.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:16:40.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:16:40.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:16:40.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:16:41.029 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-17T04:16:41.243 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-17T04:16:41.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:16:41.353 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:16:41.353 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-17T04:16:41.369 INFO:teuthology.orchestra.run.smithi112.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:16:41.370 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:16:41.370 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:16:41.370 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:16:41.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:16:41.597 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T04:16:41.597 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-17T04:16:41.656 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-508.el9.x86_64 2024-09-17T04:16:41.657 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T04:16:41.657 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T04:16:41.657 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T04:16:42.372 DEBUG:teuthology.parallel:result is None 2024-09-17T04:16:42.657 DEBUG:teuthology.parallel:result is None 2024-09-17T04:16:42.658 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T04:16:42.665 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T04:16:42.665 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:16:42.668 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T04:16:42.690 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T04:16:42.697 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T04:16:42.705 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T04:16:42.705 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:16:42.737 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T04:16:42.803 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T04:16:42.811 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T04:16:42.811 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:16:42.814 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T04:16:42.868 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:16:42.957 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:16:43.013 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:16:43.018 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T04:16:43.020 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T04:16:43.027 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T04:16:43.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:16:43.030 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T04:16:43.091 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T04:16:43.099 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T04:16:43.100 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:16:43.102 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T04:16:43.127 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:16:43.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:16:43.354 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:16:43.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:16:43.490 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:16:43.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:16:43.517 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:16:43.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T04:16:43.609 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:16:43.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T04:16:43.725 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:16:43.726 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T04:16:43.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-17T04:16:43.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-17T04:16:43.868 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:16:43.962 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:16:44.012 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T04:16:44.026 INFO:teuthology.task.internal:Starting timer... 2024-09-17T04:16:44.026 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T04:16:44.037 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T04:16:44.047 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-17T04:16:44.115 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-17T04:16:44.117 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-09-17T04:16:44.168 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-09-17T04:16:44.169 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T04:16:44.169 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-17T04:16:44.195 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-17T04:16:44.196 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-09-17T04:16:44.225 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-09-17T04:16:44.225 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive'} 2024-09-17T04:16:44.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:16:44.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:16:44.262 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:16:44.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:16:44.290 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T04:16:44.291 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:16:44.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-09-17T04:16:44.441 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T04:16:44.450 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T04:16:44.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T04:16:44.466 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi112.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T04:20:35.897 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com')] 2024-09-17T04:20:35.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:20:35.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:20:35.982 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-17T04:20:36.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-17T04:20:36.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:20:36.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T04:20:36.132 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-17T04:20:36.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-17T04:20:36.217 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T04:20:36.227 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T04:20:36.227 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:20:36.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:20:36.230 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T04:20:36.231 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:20:36.260 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:20:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:20:36.286 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T04:20:36.300 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T04:20:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-17T04:20:36.314 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-17T04:20:36.325 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-09-17T04:20:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:20:36.336 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-09-17T04:20:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:20:36.350 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T04:20:36.364 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T04:20:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:20:36.403 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:20:36.404 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-17T04:20:36.404 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.404 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.404 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.404 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.421 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:20:36.424 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:20:36.424 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-17T04:20:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:20:36.426 INFO:teuthology.run_tasks:Running task install... 2024-09-17T04:20:36.434 DEBUG:teuthology.task.install:project ceph 2024-09-17T04:20:36.434 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T04:20:36.434 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T04:20:36.434 INFO:teuthology.task.install:Using flavor: default 2024-09-17T04:20:36.440 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T04:20:36.440 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T04:20:36.441 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:20:36.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:20:36.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T04:20:36.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:20:36.591 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:20:36.592 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:20:36.598 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T04:20:36.598 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T04:20:36.707 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:20:36.708 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:20:36.708 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:20:36.712 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T04:20:36.712 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:20:36.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T04:20:36.734 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:20:36.735 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:20:36.739 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T04:20:36.739 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T04:20:36.801 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:20:36.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T04:20:36.876 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:20:36.882 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T04:20:36.940 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-09-17T04:20:36.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-09-17T04:20:36.946 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-17T04:20:36.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-17T04:20:37.179 INFO:teuthology.orchestra.run.smithi112.stdout:45 files removed 2024-09-17T04:20:37.191 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-17T04:20:37.208 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:20:37.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T04:20:37.976 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 176 kB/s | 84 kB 00:00 2024-09-17T04:20:37.978 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 183 kB/s | 84 kB 00:00 2024-09-17T04:20:38.271 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-17T04:20:38.276 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T04:20:38.538 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-17T04:20:38.560 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-17T04:20:39.080 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-17T04:20:39.463 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.3 MB 00:00 2024-09-17T04:20:41.829 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-17T04:20:42.912 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 20 MB 00:02 2024-09-17T04:20:47.817 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-17T04:20:49.802 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-17T04:20:50.133 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-17T04:20:51.212 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-17T04:20:51.558 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-17T04:20:53.204 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-17T04:20:56.793 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T04:20:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T04:20:58.997 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:20:58.998 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:20:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:20:59.012 INFO:teuthology.orchestra.run.smithi112.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:20:59.013 INFO:teuthology.orchestra.run.smithi112.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:20:59.014 INFO:teuthology.orchestra.run.smithi112.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:20:59.016 INFO:teuthology.orchestra.run.smithi112.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:20:59.019 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:20:59.020 INFO:teuthology.orchestra.run.smithi112.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:20:59.083 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:20:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:20:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:20:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:20:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:20:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:20:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:20:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:20:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:20:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:20:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:20:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:20:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout:Installing weak dependencies: 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-09-17T04:20:59.116 INFO:teuthology.orchestra.run.smithi112.stdout:======================================================================================= 2024-09-17T04:20:59.117 INFO:teuthology.orchestra.run.smithi112.stdout:Install 149 Packages 2024-09-17T04:20:59.117 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 8 Packages 2024-09-17T04:20:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:20:59.117 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 228 M 2024-09-17T04:20:59.117 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-09-17T04:20:59.453 INFO:teuthology.orchestra.run.smithi112.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-17T04:20:59.669 INFO:teuthology.orchestra.run.smithi112.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 3.9 MB/s | 873 kB 00:00 2024-09-17T04:20:59.770 INFO:teuthology.orchestra.run.smithi112.stdout:(3/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-17T04:20:59.795 INFO:teuthology.orchestra.run.smithi112.stdout:(4/157): ceph-immutable-object-cache-19.3.0-498 1.2 MB/s | 148 kB 00:00 2024-09-17T04:20:59.912 INFO:teuthology.orchestra.run.smithi112.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 16 MB/s | 2.3 MB 00:00 2024-09-17T04:21:00.045 INFO:teuthology.orchestra.run.smithi112.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 6.1 MB/s | 1.5 MB 00:00 2024-09-17T04:21:00.171 INFO:teuthology.orchestra.run.smithi112.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-17T04:21:00.405 INFO:teuthology.orchestra.run.smithi112.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 18 MB/s | 20 MB 00:01 2024-09-17T04:21:00.446 INFO:teuthology.orchestra.run.smithi112.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 609 kB/s | 25 kB 00:00 2024-09-17T04:21:00.739 INFO:teuthology.orchestra.run.smithi112.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 18 MB/s | 10 MB 00:00 2024-09-17T04:21:00.789 INFO:teuthology.orchestra.run.smithi112.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 4.4 MB/s | 225 kB 00:00 2024-09-17T04:21:00.864 INFO:teuthology.orchestra.run.smithi112.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 361 kB/s | 27 kB 00:00 2024-09-17T04:21:00.939 INFO:teuthology.orchestra.run.smithi112.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 424 kB/s | 32 kB 00:00 2024-09-17T04:21:01.040 INFO:teuthology.orchestra.run.smithi112.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 7.5 MB/s | 766 kB 00:00 2024-09-17T04:21:01.125 INFO:teuthology.orchestra.run.smithi112.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.9 MB/s | 159 kB 00:00 2024-09-17T04:21:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:21:01.304 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T04:21:01.316 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T04:21:01.316 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T04:21:01.317 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:21:01.318 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:21:01.320 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:21:01.322 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T04:21:01.323 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:21:01.324 INFO:teuthology.orchestra.run.smithi112.stdout:(16/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 14 MB/s | 18 MB 00:01 2024-09-17T04:21:01.349 INFO:teuthology.orchestra.run.smithi112.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 563 kB/s | 127 kB 00:00 2024-09-17T04:21:01.374 INFO:teuthology.orchestra.run.smithi112.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 9.9 MB/s | 507 kB 00:00 2024-09-17T04:21:01.390 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-17T04:21:01.408 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-17T04:21:01.408 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-17T04:21:01.408 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-17T04:21:01.408 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-17T04:21:01.409 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T04:21:01.409 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T04:21:01.409 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T04:21:01.409 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T04:21:01.409 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T04:21:01.410 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T04:21:01.410 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T04:21:01.410 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T04:21:01.410 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T04:21:01.410 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T04:21:01.411 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T04:21:01.411 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T04:21:01.411 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T04:21:01.411 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T04:21:01.411 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T04:21:01.412 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T04:21:01.412 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T04:21:01.412 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T04:21:01.412 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T04:21:01.412 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T04:21:01.413 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T04:21:01.413 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T04:21:01.413 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T04:21:01.413 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T04:21:01.414 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T04:21:01.414 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T04:21:01.414 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T04:21:01.414 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T04:21:01.414 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T04:21:01.415 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T04:21:01.415 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T04:21:01.415 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T04:21:01.415 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T04:21:01.415 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T04:21:01.416 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T04:21:01.416 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T04:21:01.416 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T04:21:01.416 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-17T04:21:01.417 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T04:21:01.417 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T04:21:01.417 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T04:21:01.417 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T04:21:01.417 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T04:21:01.418 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T04:21:01.418 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T04:21:01.418 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T04:21:01.418 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-17T04:21:01.419 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T04:21:01.419 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T04:21:01.419 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T04:21:01.420 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T04:21:01.421 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T04:21:01.422 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T04:21:01.423 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T04:21:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T04:21:01.425 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T04:21:01.426 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T04:21:01.427 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T04:21:01.428 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout:Install 149 Packages 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 8 Packages 2024-09-17T04:21:01.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:01.430 INFO:teuthology.orchestra.run.smithi112.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 907 kB/s | 45 kB 00:00 2024-09-17T04:21:01.430 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 228 M 2024-09-17T04:21:01.430 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-17T04:21:01.508 INFO:teuthology.orchestra.run.smithi112.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.7 MB/s | 143 kB 00:00 2024-09-17T04:21:01.625 INFO:teuthology.orchestra.run.smithi112.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-17T04:21:01.650 INFO:teuthology.orchestra.run.smithi112.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.1 MB/s | 162 kB 00:00 2024-09-17T04:21:01.675 INFO:teuthology.orchestra.run.smithi112.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T04:21:01.700 INFO:teuthology.orchestra.run.smithi112.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.9 MB/s | 305 kB 00:00 2024-09-17T04:21:01.734 INFO:teuthology.orchestra.run.smithi112.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.7 MB/s | 99 kB 00:00 2024-09-17T04:21:01.759 INFO:teuthology.orchestra.run.smithi112.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-17T04:21:01.810 INFO:teuthology.orchestra.run.smithi112.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T04:21:01.885 INFO:teuthology.orchestra.run.smithi112.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 21 MB/s | 3.1 MB 00:00 2024-09-17T04:21:01.910 INFO:teuthology.orchestra.run.smithi112.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 342 kB/s | 34 kB 00:00 2024-09-17T04:21:01.935 INFO:teuthology.orchestra.run.smithi112.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T04:21:02.119 INFO:teuthology.orchestra.run.smithi063.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-09-17T04:21:02.331 INFO:teuthology.orchestra.run.smithi063.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.0 MB/s | 873 kB 00:00 2024-09-17T04:21:02.403 INFO:teuthology.orchestra.run.smithi112.stdout:(31/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 20 MB/s | 40 MB 00:01 2024-09-17T04:21:02.453 INFO:teuthology.orchestra.run.smithi063.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.2 MB/s | 148 kB 00:00 2024-09-17T04:21:02.461 INFO:teuthology.orchestra.run.smithi112.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.9 MB/s | 291 kB 00:00 2024-09-17T04:21:02.537 INFO:teuthology.orchestra.run.smithi063.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 8.8 MB/s | 5.5 MB 00:00 2024-09-17T04:21:02.620 INFO:teuthology.orchestra.run.smithi112.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-17T04:21:02.637 INFO:teuthology.orchestra.run.smithi063.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-17T04:21:02.645 INFO:teuthology.orchestra.run.smithi112.stdout:(34/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 269 kB/s | 49 kB 00:00 2024-09-17T04:21:02.670 INFO:teuthology.orchestra.run.smithi112.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 330 kB/s | 16 kB 00:00 2024-09-17T04:21:02.687 INFO:teuthology.orchestra.run.smithi063.stdout:(6/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-17T04:21:02.712 INFO:teuthology.orchestra.run.smithi112.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 4.2 MB/s | 285 kB 00:00 2024-09-17T04:21:02.746 INFO:teuthology.orchestra.run.smithi112.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 10 MB/s | 784 kB 00:00 2024-09-17T04:21:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-17T04:21:02.897 INFO:teuthology.orchestra.run.smithi112.stdout:(38/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 14 MB/s | 14 MB 00:00 2024-09-17T04:21:02.913 INFO:teuthology.orchestra.run.smithi112.stdout:(39/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 91 kB/s | 18 kB 00:00 2024-09-17T04:21:03.014 INFO:teuthology.orchestra.run.smithi112.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 298 kB/s | 80 kB 00:00 2024-09-17T04:21:03.080 INFO:teuthology.orchestra.run.smithi112.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-17T04:21:03.106 INFO:teuthology.orchestra.run.smithi112.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-17T04:21:03.139 INFO:teuthology.orchestra.run.smithi112.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-17T04:21:03.165 INFO:teuthology.orchestra.run.smithi112.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T04:21:03.190 INFO:teuthology.orchestra.run.smithi112.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T04:21:03.215 INFO:teuthology.orchestra.run.smithi112.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T04:21:03.240 INFO:teuthology.orchestra.run.smithi112.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-17T04:21:03.282 INFO:teuthology.orchestra.run.smithi112.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-17T04:21:03.338 INFO:teuthology.orchestra.run.smithi063.stdout:(8/157): ceph-radosgw-19.3.0-4989.gce1b342b.el9 22 MB/s | 10 MB 00:00 2024-09-17T04:21:03.372 INFO:teuthology.orchestra.run.smithi063.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 756 kB/s | 25 kB 00:00 2024-09-17T04:21:03.457 INFO:teuthology.orchestra.run.smithi112.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-17T04:21:03.508 INFO:teuthology.orchestra.run.smithi112.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-17T04:21:03.533 INFO:teuthology.orchestra.run.smithi112.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-17T04:21:03.563 INFO:teuthology.orchestra.run.smithi063.stdout:(10/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 20 MB/s | 18 MB 00:00 2024-09-17T04:21:03.576 INFO:teuthology.orchestra.run.smithi112.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-17T04:21:03.600 INFO:teuthology.orchestra.run.smithi112.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-17T04:21:03.613 INFO:teuthology.orchestra.run.smithi063.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 4.4 MB/s | 225 kB 00:00 2024-09-17T04:21:03.650 INFO:teuthology.orchestra.run.smithi112.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-17T04:21:03.676 INFO:teuthology.orchestra.run.smithi112.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-17T04:21:03.680 INFO:teuthology.orchestra.run.smithi063.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 406 kB/s | 27 kB 00:00 2024-09-17T04:21:03.701 INFO:teuthology.orchestra.run.smithi112.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-17T04:21:03.735 INFO:teuthology.orchestra.run.smithi112.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-17T04:21:03.748 INFO:teuthology.orchestra.run.smithi063.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 478 kB/s | 32 kB 00:00 2024-09-17T04:21:03.760 INFO:teuthology.orchestra.run.smithi112.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-17T04:21:03.793 INFO:teuthology.orchestra.run.smithi112.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-17T04:21:03.848 INFO:teuthology.orchestra.run.smithi063.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 7.5 MB/s | 766 kB 00:00 2024-09-17T04:21:03.915 INFO:teuthology.orchestra.run.smithi063.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.3 MB/s | 159 kB 00:00 2024-09-17T04:21:03.919 INFO:teuthology.orchestra.run.smithi112.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-17T04:21:03.952 INFO:teuthology.orchestra.run.smithi112.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-17T04:21:03.978 INFO:teuthology.orchestra.run.smithi112.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-17T04:21:03.990 INFO:teuthology.orchestra.run.smithi063.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 1.7 MB/s | 127 kB 00:00 2024-09-17T04:21:04.011 INFO:teuthology.orchestra.run.smithi112.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-17T04:21:04.070 INFO:teuthology.orchestra.run.smithi112.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-17T04:21:04.090 INFO:teuthology.orchestra.run.smithi063.stdout:(17/157): libradosstriper1-19.3.0-4989.gce1b342 5.0 MB/s | 507 kB 00:00 2024-09-17T04:21:04.120 INFO:teuthology.orchestra.run.smithi112.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-09-17T04:21:04.154 INFO:teuthology.orchestra.run.smithi112.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-17T04:21:04.424 INFO:teuthology.orchestra.run.smithi063.stdout:(18/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 16 MB/s | 5.3 MB 00:00 2024-09-17T04:21:04.474 INFO:teuthology.orchestra.run.smithi063.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 907 kB/s | 45 kB 00:00 2024-09-17T04:21:04.841 INFO:teuthology.orchestra.run.smithi063.stdout:(20/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 27 MB/s | 40 MB 00:01 2024-09-17T04:21:04.854 INFO:teuthology.orchestra.run.smithi112.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-09-17T04:21:04.866 INFO:teuthology.orchestra.run.smithi063.stdout:(21/157): python3-ceph-common-19.3.0-4989.gce1b 365 kB/s | 143 kB 00:00 2024-09-17T04:21:04.891 INFO:teuthology.orchestra.run.smithi063.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 3.2 MB/s | 162 kB 00:00 2024-09-17T04:21:04.933 INFO:teuthology.orchestra.run.smithi063.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 4.7 MB/s | 321 kB 00:00 2024-09-17T04:21:04.958 INFO:teuthology.orchestra.run.smithi063.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 4.5 MB/s | 305 kB 00:00 2024-09-17T04:21:04.984 INFO:teuthology.orchestra.run.smithi063.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T04:21:05.009 INFO:teuthology.orchestra.run.smithi063.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T04:21:05.067 INFO:teuthology.orchestra.run.smithi063.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-17T04:21:05.126 INFO:teuthology.orchestra.run.smithi063.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 22 MB/s | 3.1 MB 00:00 2024-09-17T04:21:05.151 INFO:teuthology.orchestra.run.smithi063.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 410 kB/s | 34 kB 00:00 2024-09-17T04:21:05.177 INFO:teuthology.orchestra.run.smithi063.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T04:21:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-09-17T04:21:05.377 INFO:teuthology.orchestra.run.smithi063.stdout:(31/157): ceph-common-19.3.0-4989.gce1b342b.el9 5.7 MB/s | 20 MB 00:03 2024-09-17T04:21:05.427 INFO:teuthology.orchestra.run.smithi063.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 5.7 MB/s | 291 kB 00:00 2024-09-17T04:21:05.511 INFO:teuthology.orchestra.run.smithi063.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 593 kB/s | 49 kB 00:00 2024-09-17T04:21:05.611 INFO:teuthology.orchestra.run.smithi063.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-17T04:21:05.636 INFO:teuthology.orchestra.run.smithi063.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 132 kB/s | 16 kB 00:00 2024-09-17T04:21:05.662 INFO:teuthology.orchestra.run.smithi063.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 5.6 MB/s | 285 kB 00:00 2024-09-17T04:21:05.704 INFO:teuthology.orchestra.run.smithi063.stdout:(37/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 440 kB/s | 18 kB 00:00 2024-09-17T04:21:05.713 INFO:teuthology.orchestra.run.smithi112.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-17T04:21:05.729 INFO:teuthology.orchestra.run.smithi063.stdout:(38/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-17T04:21:05.830 INFO:teuthology.orchestra.run.smithi112.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-17T04:21:05.871 INFO:teuthology.orchestra.run.smithi063.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 20 MB/s | 14 MB 00:00 2024-09-17T04:21:05.888 INFO:teuthology.orchestra.run.smithi063.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 434 kB/s | 80 kB 00:00 2024-09-17T04:21:05.971 INFO:teuthology.orchestra.run.smithi063.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-17T04:21:05.997 INFO:teuthology.orchestra.run.smithi063.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T04:21:06.038 INFO:teuthology.orchestra.run.smithi112.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.6 MB/s | 4.9 MB 00:01 2024-09-17T04:21:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-17T04:21:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-17T04:21:06.106 INFO:teuthology.orchestra.run.smithi063.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T04:21:06.131 INFO:teuthology.orchestra.run.smithi063.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T04:21:06.139 INFO:teuthology.orchestra.run.smithi112.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:01 2024-09-17T04:21:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-17T04:21:06.190 INFO:teuthology.orchestra.run.smithi063.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-17T04:21:06.232 INFO:teuthology.orchestra.run.smithi112.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-09-17T04:21:06.357 INFO:teuthology.orchestra.run.smithi063.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 641 kB/s | 107 kB 00:00 2024-09-17T04:21:06.407 INFO:teuthology.orchestra.run.smithi063.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-17T04:21:06.432 INFO:teuthology.orchestra.run.smithi063.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-17T04:21:06.482 INFO:teuthology.orchestra.run.smithi063.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-09-17T04:21:06.516 INFO:teuthology.orchestra.run.smithi063.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-17T04:21:06.541 INFO:teuthology.orchestra.run.smithi063.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-17T04:21:06.567 INFO:teuthology.orchestra.run.smithi063.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-17T04:21:06.592 INFO:teuthology.orchestra.run.smithi063.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-17T04:21:06.623 INFO:teuthology.orchestra.run.smithi112.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-17T04:21:06.642 INFO:teuthology.orchestra.run.smithi063.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-17T04:21:06.659 INFO:teuthology.orchestra.run.smithi063.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-17T04:21:06.664 INFO:teuthology.orchestra.run.smithi112.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-17T04:21:06.693 INFO:teuthology.orchestra.run.smithi063.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-17T04:21:06.815 INFO:teuthology.orchestra.run.smithi112.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-17T04:21:06.860 INFO:teuthology.orchestra.run.smithi063.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-17T04:21:06.885 INFO:teuthology.orchestra.run.smithi063.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-17T04:21:06.910 INFO:teuthology.orchestra.run.smithi063.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-17T04:21:06.935 INFO:teuthology.orchestra.run.smithi063.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-17T04:21:06.973 INFO:teuthology.orchestra.run.smithi112.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-17T04:21:07.010 INFO:teuthology.orchestra.run.smithi063.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-17T04:21:07.015 INFO:teuthology.orchestra.run.smithi112.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-17T04:21:07.036 INFO:teuthology.orchestra.run.smithi063.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-17T04:21:07.057 INFO:teuthology.orchestra.run.smithi112.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-17T04:21:07.061 INFO:teuthology.orchestra.run.smithi063.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-17T04:21:07.174 INFO:teuthology.orchestra.run.smithi112.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T04:21:07.225 INFO:teuthology.orchestra.run.smithi112.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-17T04:21:07.378 INFO:teuthology.orchestra.run.smithi063.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-17T04:21:07.828 INFO:teuthology.orchestra.run.smithi063.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-17T04:21:08.029 INFO:teuthology.orchestra.run.smithi063.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-09-17T04:21:08.120 INFO:teuthology.orchestra.run.smithi063.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-09-17T04:21:08.154 INFO:teuthology.orchestra.run.smithi063.stdout:(71/157): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-17T04:21:08.179 INFO:teuthology.orchestra.run.smithi063.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 915 kB/s | 137 kB 00:00 2024-09-17T04:21:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-17T04:21:08.488 INFO:teuthology.orchestra.run.smithi063.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-09-17T04:21:08.546 INFO:teuthology.orchestra.run.smithi063.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-17T04:21:08.772 INFO:teuthology.orchestra.run.smithi063.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-17T04:21:08.892 INFO:teuthology.orchestra.run.smithi112.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:03 2024-09-17T04:21:08.998 INFO:teuthology.orchestra.run.smithi063.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-17T04:21:08.998 INFO:teuthology.orchestra.run.smithi063.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-17T04:21:09.040 INFO:teuthology.orchestra.run.smithi063.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-17T04:21:09.084 INFO:teuthology.orchestra.run.smithi112.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-09-17T04:21:09.123 INFO:teuthology.orchestra.run.smithi063.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-17T04:21:09.165 INFO:teuthology.orchestra.run.smithi063.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-09-17T04:21:09.234 INFO:teuthology.orchestra.run.smithi112.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-17T04:21:09.282 INFO:teuthology.orchestra.run.smithi063.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-17T04:21:09.325 INFO:teuthology.orchestra.run.smithi112.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 844 kB/s | 77 kB 00:00 2024-09-17T04:21:09.349 INFO:teuthology.orchestra.run.smithi063.stdout:(83/157): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-17T04:21:09.374 INFO:teuthology.orchestra.run.smithi063.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-17T04:21:09.424 INFO:teuthology.orchestra.run.smithi063.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T04:21:09.425 INFO:teuthology.orchestra.run.smithi112.stdout:(86/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-17T04:21:09.449 INFO:teuthology.orchestra.run.smithi063.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-17T04:21:09.451 INFO:teuthology.orchestra.run.smithi112.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-09-17T04:21:09.474 INFO:teuthology.orchestra.run.smithi063.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-17T04:21:09.525 INFO:teuthology.orchestra.run.smithi063.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T04:21:09.550 INFO:teuthology.orchestra.run.smithi063.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-17T04:21:09.559 INFO:teuthology.orchestra.run.smithi112.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-17T04:21:09.601 INFO:teuthology.orchestra.run.smithi063.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T04:21:09.610 INFO:teuthology.orchestra.run.smithi112.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-17T04:21:09.634 INFO:teuthology.orchestra.run.smithi063.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-17T04:21:09.659 INFO:teuthology.orchestra.run.smithi063.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 919 kB/s | 54 kB 00:00 2024-09-17T04:21:09.660 INFO:teuthology.orchestra.run.smithi112.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T04:21:09.710 INFO:teuthology.orchestra.run.smithi063.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 837 kB/s | 42 kB 00:00 2024-09-17T04:21:09.710 INFO:teuthology.orchestra.run.smithi112.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T04:21:09.760 INFO:teuthology.orchestra.run.smithi063.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-09-17T04:21:09.769 INFO:teuthology.orchestra.run.smithi112.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-17T04:21:09.819 INFO:teuthology.orchestra.run.smithi112.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-17T04:21:09.843 INFO:teuthology.orchestra.run.smithi063.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-17T04:21:09.869 INFO:teuthology.orchestra.run.smithi112.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-17T04:21:09.910 INFO:teuthology.orchestra.run.smithi063.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-17T04:21:09.953 INFO:teuthology.orchestra.run.smithi112.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-17T04:21:09.969 INFO:teuthology.orchestra.run.smithi063.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 816 kB/s | 47 kB 00:00 2024-09-17T04:21:10.012 INFO:teuthology.orchestra.run.smithi112.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-09-17T04:21:10.069 INFO:teuthology.orchestra.run.smithi063.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-17T04:21:10.078 INFO:teuthology.orchestra.run.smithi112.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-09-17T04:21:10.104 INFO:teuthology.orchestra.run.smithi112.stdout:(98/157): qatlib-24.02.0-1.el9.x86_64.rpm 943 kB/s | 221 kB 00:00 2024-09-17T04:21:10.128 INFO:teuthology.orchestra.run.smithi063.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-09-17T04:21:10.171 INFO:teuthology.orchestra.run.smithi112.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-17T04:21:10.195 INFO:teuthology.orchestra.run.smithi063.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-17T04:21:10.253 INFO:teuthology.orchestra.run.smithi063.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-17T04:21:10.254 INFO:teuthology.orchestra.run.smithi112.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-17T04:21:10.297 INFO:teuthology.orchestra.run.smithi112.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-17T04:21:10.303 INFO:teuthology.orchestra.run.smithi063.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-17T04:21:10.348 INFO:teuthology.orchestra.run.smithi112.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-09-17T04:21:10.372 INFO:teuthology.orchestra.run.smithi112.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-17T04:21:10.447 INFO:teuthology.orchestra.run.smithi112.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-17T04:21:10.514 INFO:teuthology.orchestra.run.smithi112.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-17T04:21:10.556 INFO:teuthology.orchestra.run.smithi112.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-17T04:21:10.581 INFO:teuthology.orchestra.run.smithi112.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-17T04:21:10.587 INFO:teuthology.orchestra.run.smithi063.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-17T04:21:10.623 INFO:teuthology.orchestra.run.smithi112.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-17T04:21:10.649 INFO:teuthology.orchestra.run.smithi112.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T04:21:10.682 INFO:teuthology.orchestra.run.smithi112.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-17T04:21:10.716 INFO:teuthology.orchestra.run.smithi112.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-17T04:21:10.737 INFO:teuthology.orchestra.run.smithi063.stdout:(104/157): python3-numpy-1.20.1-5.el9.x86_64.rp 3.2 MB/s | 5.1 MB 00:01 2024-09-17T04:21:10.758 INFO:teuthology.orchestra.run.smithi112.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-17T04:21:10.821 INFO:teuthology.orchestra.run.smithi063.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-17T04:21:10.858 INFO:teuthology.orchestra.run.smithi112.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-17T04:21:10.863 INFO:teuthology.orchestra.run.smithi063.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-17T04:21:10.888 INFO:teuthology.orchestra.run.smithi063.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-17T04:21:10.891 INFO:teuthology.orchestra.run.smithi112.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-17T04:21:10.934 INFO:teuthology.orchestra.run.smithi112.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-17T04:21:10.959 INFO:teuthology.orchestra.run.smithi112.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-09-17T04:21:10.984 INFO:teuthology.orchestra.run.smithi112.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-09-17T04:21:11.010 INFO:teuthology.orchestra.run.smithi112.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-17T04:21:11.035 INFO:teuthology.orchestra.run.smithi112.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T04:21:11.060 INFO:teuthology.orchestra.run.smithi112.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-17T04:21:11.080 INFO:teuthology.orchestra.run.smithi063.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-17T04:21:11.085 INFO:teuthology.orchestra.run.smithi112.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-17T04:21:11.105 INFO:teuthology.orchestra.run.smithi063.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T04:21:11.111 INFO:teuthology.orchestra.run.smithi112.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T04:21:11.131 INFO:teuthology.orchestra.run.smithi063.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T04:21:11.144 INFO:teuthology.orchestra.run.smithi112.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-17T04:21:11.156 INFO:teuthology.orchestra.run.smithi063.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T04:21:11.170 INFO:teuthology.orchestra.run.smithi112.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-17T04:21:11.189 INFO:teuthology.orchestra.run.smithi063.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-17T04:21:11.195 INFO:teuthology.orchestra.run.smithi112.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-17T04:21:11.220 INFO:teuthology.orchestra.run.smithi112.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-17T04:21:11.240 INFO:teuthology.orchestra.run.smithi063.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-17T04:21:11.245 INFO:teuthology.orchestra.run.smithi112.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-17T04:21:11.282 INFO:teuthology.orchestra.run.smithi063.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-17T04:21:11.304 INFO:teuthology.orchestra.run.smithi112.stdout:(128/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-17T04:21:11.307 INFO:teuthology.orchestra.run.smithi063.stdout:(115/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-09-17T04:21:11.329 INFO:teuthology.orchestra.run.smithi112.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2024-09-17T04:21:11.332 INFO:teuthology.orchestra.run.smithi063.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-09-17T04:21:11.363 INFO:teuthology.orchestra.run.smithi112.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-17T04:21:11.366 INFO:teuthology.orchestra.run.smithi063.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 554 kB/s | 14 kB 00:00 2024-09-17T04:21:11.397 INFO:teuthology.orchestra.run.smithi112.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T04:21:11.399 INFO:teuthology.orchestra.run.smithi063.stdout:(118/157): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-09-17T04:21:11.422 INFO:teuthology.orchestra.run.smithi112.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T04:21:11.425 INFO:teuthology.orchestra.run.smithi063.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.0 MB/s | 172 kB 00:00 2024-09-17T04:21:11.455 INFO:teuthology.orchestra.run.smithi112.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-17T04:21:11.467 INFO:teuthology.orchestra.run.smithi063.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-17T04:21:11.472 INFO:teuthology.orchestra.run.smithi112.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 993 kB/s | 16 kB 00:00 2024-09-17T04:21:11.492 INFO:teuthology.orchestra.run.smithi063.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-09-17T04:21:11.506 INFO:teuthology.orchestra.run.smithi112.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-17T04:21:11.517 INFO:teuthology.orchestra.run.smithi063.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T04:21:11.531 INFO:teuthology.orchestra.run.smithi112.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-17T04:21:11.551 INFO:teuthology.orchestra.run.smithi063.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-17T04:21:11.557 INFO:teuthology.orchestra.run.smithi112.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-17T04:21:11.573 INFO:teuthology.orchestra.run.smithi112.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-17T04:21:11.576 INFO:teuthology.orchestra.run.smithi063.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-17T04:21:11.599 INFO:teuthology.orchestra.run.smithi112.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-17T04:21:11.617 INFO:teuthology.orchestra.run.smithi112.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-17T04:21:11.633 INFO:teuthology.orchestra.run.smithi112.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-17T04:21:11.743 INFO:teuthology.orchestra.run.smithi063.stdout:(125/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.7 MB/s | 16 MB 00:02 2024-09-17T04:21:11.768 INFO:teuthology.orchestra.run.smithi063.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 92 kB/s | 18 kB 00:00 2024-09-17T04:21:11.783 INFO:teuthology.orchestra.run.smithi112.stdout:(142/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-09-17T04:21:11.802 INFO:teuthology.orchestra.run.smithi063.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-17T04:21:11.808 INFO:teuthology.orchestra.run.smithi112.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 388 kB/s | 74 kB 00:00 2024-09-17T04:21:11.827 INFO:teuthology.orchestra.run.smithi063.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 863 kB/s | 20 kB 00:00 2024-09-17T04:21:11.842 INFO:teuthology.orchestra.run.smithi112.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-09-17T04:21:11.852 INFO:teuthology.orchestra.run.smithi063.stdout:(129/157): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-09-17T04:21:11.878 INFO:teuthology.orchestra.run.smithi063.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T04:21:11.884 INFO:teuthology.orchestra.run.smithi112.stdout:(145/157): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-09-17T04:21:11.909 INFO:teuthology.orchestra.run.smithi112.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 307 kB/s | 20 kB 00:00 2024-09-17T04:21:11.920 INFO:teuthology.orchestra.run.smithi063.stdout:(131/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-17T04:21:11.943 INFO:teuthology.orchestra.run.smithi112.stdout:(147/157): python3-websocket-client-1.2.3-2.el9 565 kB/s | 90 kB 00:00 2024-09-17T04:21:11.945 INFO:teuthology.orchestra.run.smithi063.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-17T04:21:11.962 INFO:teuthology.orchestra.run.smithi063.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-09-17T04:21:11.968 INFO:teuthology.orchestra.run.smithi112.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T04:21:11.987 INFO:teuthology.orchestra.run.smithi063.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-17T04:21:12.021 INFO:teuthology.orchestra.run.smithi063.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-17T04:21:12.043 INFO:teuthology.orchestra.run.smithi112.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-17T04:21:12.046 INFO:teuthology.orchestra.run.smithi063.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-17T04:21:12.086 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.096 INFO:teuthology.orchestra.run.smithi063.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-09-17T04:21:12.122 INFO:teuthology.orchestra.run.smithi063.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 671 kB/s | 90 kB 00:00 2024-09-17T04:21:12.147 INFO:teuthology.orchestra.run.smithi063.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-09-17T04:21:12.172 INFO:teuthology.orchestra.run.smithi063.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-17T04:21:12.197 INFO:teuthology.orchestra.run.smithi063.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-17T04:21:12.210 INFO:teuthology.orchestra.run.smithi112.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T04:21:12.211 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.222 INFO:teuthology.orchestra.run.smithi063.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-17T04:21:12.248 INFO:teuthology.orchestra.run.smithi063.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-17T04:21:12.269 INFO:teuthology.orchestra.run.smithi112.stdout:(151/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-17T04:21:12.269 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.273 INFO:teuthology.orchestra.run.smithi063.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T04:21:12.291 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-team-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.291 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-libnm-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.298 INFO:teuthology.orchestra.run.smithi063.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T04:21:12.312 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-team-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-team-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.324 INFO:teuthology.orchestra.run.smithi063.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-17T04:21:12.349 INFO:teuthology.orchestra.run.smithi063.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T04:21:12.361 INFO:teuthology.orchestra.run.smithi112.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2024-09-17T04:21:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-17T04:21:12.382 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-tui-1.51.0-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-tui-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.403 INFO:teuthology.orchestra.run.smithi112.stdout:[MIRROR] NetworkManager-tui-1.51.0-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/NetworkManager-tui-1.51.0-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:21:12.424 INFO:teuthology.orchestra.run.smithi063.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T04:21:12.453 INFO:teuthology.orchestra.run.smithi112.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 223 kB/s | 41 kB 00:00 2024-09-17T04:21:12.478 INFO:teuthology.orchestra.run.smithi112.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-17T04:21:12.587 INFO:teuthology.orchestra.run.smithi112.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-17T04:21:12.608 INFO:teuthology.orchestra.run.smithi063.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T04:21:12.666 INFO:teuthology.orchestra.run.smithi063.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 9.6 MB/s | 2.3 MB 00:00 2024-09-17T04:21:12.687 INFO:teuthology.orchestra.run.smithi112.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-17T04:21:12.717 INFO:teuthology.orchestra.run.smithi063.stdout:(152/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 9.2 MB/s | 3.2 MB 00:00 2024-09-17T04:21:12.729 INFO:teuthology.orchestra.run.smithi112.stdout:(157/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-09-17T04:21:12.735 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:21:12.735 INFO:teuthology.orchestra.run.smithi112.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-17T04:21:12.742 INFO:teuthology.orchestra.run.smithi063.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 544 kB/s | 41 kB 00:00 2024-09-17T04:21:12.801 INFO:teuthology.orchestra.run.smithi063.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.4 MB/s | 1.8 MB 00:00 2024-09-17T04:21:12.826 INFO:teuthology.orchestra.run.smithi063.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-17T04:21:12.868 INFO:teuthology.orchestra.run.smithi063.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-17T04:21:12.918 INFO:teuthology.orchestra.run.smithi063.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-17T04:21:12.924 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:21:12.924 INFO:teuthology.orchestra.run.smithi063.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-17T04:21:13.980 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-09-17T04:21:14.135 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-09-17T04:21:14.136 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-09-17T04:21:14.187 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-17T04:21:14.362 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-17T04:21:14.362 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-17T04:21:16.394 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-09-17T04:21:16.394 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-09-17T04:21:16.718 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-17T04:21:16.718 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-17T04:21:22.928 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-09-17T04:21:23.057 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:21:23.104 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:21:23.166 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:21:23.199 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:21:23.225 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:21:23.279 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:21:23.502 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-17T04:21:23.606 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T04:21:23.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T04:21:23.690 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:21:23.707 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T04:21:23.750 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:21:23.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T04:21:23.867 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:21:23.871 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T04:21:23.901 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:21:23.923 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T04:21:23.984 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:21:24.017 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:21:24.053 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:21:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:21:24.290 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T04:21:24.296 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:21:24.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:21:24.397 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:21:24.412 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:21:24.441 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:21:24.504 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:21:24.518 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:21:24.533 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:21:24.540 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:21:24.559 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:21:24.624 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:21:24.656 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:21:24.691 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T04:21:24.727 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:21:24.879 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T04:21:24.899 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:21:24.943 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T04:21:24.970 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:21:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:21:25.077 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:21:25.104 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:21:25.147 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:25.184 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T04:21:25.214 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:21:25.224 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:25.240 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T04:21:25.407 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:21:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:25.558 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:21:25.577 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T04:21:25.601 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:21:25.647 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:21:25.745 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:21:25.796 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:21:25.829 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:21:25.846 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T04:21:25.872 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:21:25.905 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:21:25.933 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:21:25.952 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:26.001 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:21:26.029 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:26.063 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:21:26.103 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:21:26.153 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:21:26.231 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:21:26.258 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T04:21:26.273 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:21:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:21:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:21:26.373 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T04:21:26.402 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T04:21:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:21:26.454 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T04:21:26.460 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:21:26.542 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:21:26.545 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T04:21:26.682 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:21:26.720 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T04:21:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:21:26.769 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T04:21:26.812 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T04:21:26.845 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T04:21:26.872 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T04:21:26.943 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T04:21:26.996 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T04:21:27.026 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T04:21:27.069 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T04:21:27.156 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T04:21:27.196 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T04:21:27.240 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T04:21:27.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:21:27.268 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T04:21:27.332 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:21:27.341 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T04:21:27.362 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:21:27.392 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T04:21:27.396 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:21:27.434 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:21:27.469 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T04:21:27.485 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:21:27.613 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T04:21:27.659 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:21:27.661 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T04:21:27.720 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:21:27.819 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:21:27.893 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:21:27.964 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:21:27.997 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:21:28.033 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:21:28.079 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:21:28.116 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:21:28.167 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:21:28.217 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:21:28.225 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T04:21:28.317 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T04:21:28.352 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T04:21:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:21:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:21:28.426 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T04:21:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:21:28.466 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T04:21:28.509 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T04:21:28.529 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:21:28.561 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:21:28.611 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:21:28.660 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:21:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T04:21:28.684 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:21:28.744 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T04:21:28.830 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:21:28.839 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T04:21:28.902 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T04:21:28.983 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T04:21:29.020 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T04:21:29.057 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T04:21:29.104 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T04:21:29.139 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T04:21:29.140 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:21:29.183 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T04:21:29.186 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:21:29.225 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T04:21:29.236 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:21:29.273 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:21:29.312 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:21:29.344 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:21:29.368 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T04:21:29.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:21:29.408 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:21:29.410 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T04:21:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:21:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:21:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:21:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:21:29.664 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:21:29.687 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T04:21:29.696 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:21:29.797 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:21:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:21:29.866 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T04:21:29.902 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T04:21:29.943 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T04:21:29.975 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T04:21:30.000 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T04:21:30.108 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T04:21:30.243 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T04:21:30.282 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T04:21:30.310 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T04:21:30.339 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T04:21:30.378 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T04:21:30.418 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T04:21:30.456 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T04:21:30.491 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T04:21:30.524 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T04:21:30.566 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:21:30.574 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T04:21:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:21:30.617 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T04:21:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:21:30.742 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:21:30.799 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:21:30.824 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T04:21:30.852 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:21:30.872 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T04:21:30.903 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T04:21:30.949 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:21:30.988 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:21:31.010 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T04:21:31.064 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T04:21:31.172 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:21:31.202 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:21:31.298 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:21:31.835 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T04:21:31.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T04:21:31.918 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T04:21:31.949 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:21:32.021 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T04:21:32.066 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:21:32.074 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T04:21:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T04:21:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T04:21:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T04:21:32.463 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T04:21:32.501 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T04:21:32.581 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T04:21:33.287 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T04:21:33.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:21:33.410 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T04:21:33.414 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:21:33.442 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:21:33.474 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:21:33.798 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:21:33.846 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:21:33.937 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:21:33.967 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:21:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:21:34.510 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:21:34.549 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:21:34.619 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:21:34.642 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:21:34.755 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T04:21:34.838 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T04:21:34.875 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T04:21:34.907 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T04:21:35.268 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T04:21:35.320 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:21:35.420 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T04:21:35.458 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T04:21:35.509 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T04:21:36.047 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T04:21:36.081 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:21:36.136 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T04:21:36.166 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T04:21:36.890 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:36.930 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:37.499 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:21:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:21:37.617 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:21:37.617 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:21:37.617 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:37.668 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:21:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:38.604 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:39.218 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T04:21:39.257 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:21:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T04:21:39.333 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T04:21:39.333 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T04:21:39.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:39.374 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:21:49.799 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:21:49.800 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-09-17T04:21:49.800 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-09-17T04:21:49.800 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-09-17T04:21:49.800 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-09-17T04:21:49.800 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-09-17T04:21:49.801 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /root 2024-09-17T04:21:49.801 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-09-17T04:21:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:49.972 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:21:49.989 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:21:49.990 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:49.990 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:21:49.990 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:51.549 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:21:51.576 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:21:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:21:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:21:51.576 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:21:51.577 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:51.809 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:21:51.832 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:21:51.832 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:51.832 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:21:51.832 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:21:51.832 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:21:51.833 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-17T04:21:52.145 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-17T04:21:52.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:52.326 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:21:52.335 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:21:52.349 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:21:52.349 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:52.350 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:21:52.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:21:52.350 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:21:52.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:52.351 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T04:21:52.352 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:52.352 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T04:21:52.352 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:52.464 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:21:52.521 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:21:52.576 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:21:52.768 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:21:52.818 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:21:52.895 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:21:52.983 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:21:53.131 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:21:53.184 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:21:53.217 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:21:53.244 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:21:53.684 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:21:53.712 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:21:53.742 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:21:53.808 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:21:53.832 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:21:54.013 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T04:21:54.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:54.288 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:21:54.313 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T04:21:54.313 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:54.313 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T04:21:54.314 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:21:54.314 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T04:21:54.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:54.813 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:21:54.838 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T04:21:54.838 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:54.838 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T04:21:54.838 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:21:54.839 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T04:21:54.839 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:21:54.945 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T04:21:55.003 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T04:21:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T04:21:55.279 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T04:21:55.323 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T04:21:55.404 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T04:21:55.494 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T04:21:55.645 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T04:21:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T04:21:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T04:21:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T04:21:56.189 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:21:56.206 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T04:21:56.238 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T04:21:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T04:21:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:21:57.004 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:21:57.071 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:21:58.028 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:21:58.055 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:21:58.168 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:21:58.338 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:21:58.365 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:21:58.389 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:21:58.390 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:58.390 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:21:58.390 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:21:58.390 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:21:58.390 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:58.441 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:21:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:21:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:21:58.603 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:21:59.559 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:21:59.585 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:21:59.609 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:21:59.609 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:59.609 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:21:59.609 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:21:59.609 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:21:59.610 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:59.661 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:21:59.683 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:21:59.683 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:59.683 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:21:59.683 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:59.728 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:21:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T04:21:59.751 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:21:59.751 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:21:59.752 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:21:59.752 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:21:59.752 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:21:59.752 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:21:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:22:00.070 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:22:00.094 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:22:00.094 INFO:teuthology.orchestra.run.smithi112.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:00.094 INFO:teuthology.orchestra.run.smithi112.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:22:00.094 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:22:00.094 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:22:00.095 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:00.818 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T04:22:00.843 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:22:00.965 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T04:22:01.134 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T04:22:01.262 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:22:01.287 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T04:22:01.287 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:01.287 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T04:22:01.288 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:22:01.288 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T04:22:01.288 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:01.337 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:22:01.349 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T04:22:01.444 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T04:22:01.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T04:22:02.522 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T04:22:02.556 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T04:22:02.581 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:02.623 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:22:02.647 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T04:22:02.647 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:02.647 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T04:22:02.647 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:02.699 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T04:22:02.724 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:03.058 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:22:03.082 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T04:22:03.083 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T04:22:03.083 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T04:22:03.083 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:22:03.083 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T04:22:03.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:04.083 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:22:04.150 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:22:04.189 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:22:04.221 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:22:04.249 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:22:04.439 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:22:04.487 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:22:04.517 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:22:04.547 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:22:04.593 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:22:05.236 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:05.273 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:05.294 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:06.121 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:22:06.194 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:22:06.240 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:22:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:22:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:22:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:22:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:22:06.407 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:22:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:22:06.499 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:22:06.583 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:22:06.608 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:22:06.614 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:06.614 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:06.802 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:06.802 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:22:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:22:06.951 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:07.313 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T04:22:07.354 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T04:22:07.395 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T04:22:07.426 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T04:22:07.453 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T04:22:07.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T04:22:07.700 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T04:22:07.730 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T04:22:07.760 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T04:22:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T04:22:08.449 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:08.486 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:08.507 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T04:22:09.427 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T04:22:09.540 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T04:22:09.594 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T04:22:09.693 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T04:22:09.727 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T04:22:09.752 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T04:22:09.786 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T04:22:09.787 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:22:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T04:22:09.887 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:22:09.971 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T04:22:09.996 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T04:22:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:10.001 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:10.189 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T04:22:10.190 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:22:10.273 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T04:22:10.350 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:13.503 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:13.503 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:22:13.503 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:22:13.504 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:22:13.505 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:22:13.506 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:22:13.518 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:22:13.519 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:22:13.520 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:22:13.521 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:22:13.522 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:22:13.523 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:22:13.524 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:22:13.525 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:22:13.526 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:22:13.527 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:22:13.528 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:22:13.529 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.129 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.130 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.131 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:22:16.132 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:22:16.133 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:22:16.134 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:22:16.135 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:22:16.136 INFO:teuthology.orchestra.run.smithi112.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:22:16.137 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:22:16.138 INFO:teuthology.orchestra.run.smithi112.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:22:16.139 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:22:16.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.141 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:22:16.142 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:22:16.143 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:16.143 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-09-17T04:22:16.565 DEBUG:teuthology.parallel:result is None 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T04:22:16.600 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T04:22:16.601 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T04:22:16.602 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T04:22:16.603 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T04:22:16.604 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T04:22:16.605 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T04:22:16.606 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T04:22:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T04:22:16.608 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T04:22:16.609 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T04:22:16.610 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T04:22:16.611 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T04:22:16.612 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T04:22:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T04:22:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:18.989 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-17T04:22:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:18.989 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.991 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.992 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T04:22:18.993 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T04:22:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T04:22:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T04:22:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T04:22:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T04:22:18.994 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.995 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T04:22:18.996 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T04:22:18.997 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T04:22:18.998 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T04:22:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T04:22:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T04:22:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T04:22:18.999 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T04:22:19.000 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T04:22:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T04:22:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T04:22:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T04:22:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T04:22:19.001 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.002 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T04:22:19.003 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T04:22:19.004 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T04:22:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T04:22:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T04:22:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T04:22:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T04:22:19.005 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T04:22:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T04:22:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T04:22:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T04:22:19.006 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T04:22:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T04:22:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T04:22:19.007 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T04:22:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T04:22:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T04:22:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T04:22:19.008 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T04:22:19.009 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.010 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T04:22:19.011 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T04:22:19.012 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T04:22:19.013 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T04:22:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T04:22:19.014 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:19.014 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-17T04:22:19.417 DEBUG:teuthology.parallel:result is None 2024-09-17T04:22:19.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:22:19.563 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:22:19.586 INFO:teuthology.orchestra.run.smithi063.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:22:19.586 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:22:19.587 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:22:19.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T04:22:19.726 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T04:22:19.752 INFO:teuthology.orchestra.run.smithi112.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T04:22:19.753 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T04:22:19.753 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T04:22:19.755 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T04:22:19.755 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:19.755 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:22:19.784 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:19.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T04:22:19.823 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T04:22:19.823 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:19.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:22:19.851 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:22:19.918 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:19.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T04:22:19.948 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T04:22:20.016 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T04:22:20.016 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:20.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:22:20.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:22:20.109 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:20.109 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T04:22:20.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T04:22:20.204 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T04:22:20.205 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:20.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:22:20.230 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:22:20.296 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:20.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T04:22:20.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T04:22:20.389 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T04:22:20.479 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T04:22:20.480 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-17T04:22:20.482 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-17T04:22:20.509 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T04:22:20.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:22:20.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T04:22:20.577 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T04:22:20.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:22:20.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T04:22:20.650 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T04:22:20.650 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T04:22:20.650 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T04:22:20.650 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:20.650 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:22:20.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:20.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:20.836 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:20.836 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T04:22:20.852 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:20.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:20.990 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T04:22:20.990 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T04:22:20.990 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/acls}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908525', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXDY8ssJDh63fpIN0T3XhnVurPCalWG0on22dG9zadg0Zzkhb1D20nQOMIlSdGjQZMXMldQmWdo0cBJrpscrMA=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJeS96gwWxnrkMwk3ych3pRTvxUqb6POx9WIa0EcVkdd1q2T4dPTFSAcCc8WKMiL4uA/zhCJiMkISCN7pOms6bQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T04:22:20.991 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:22:20.993 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T04:22:21.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:22:21.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T04:22:21.105 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:21.105 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:22:21.127 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:22:21.128 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-17T04:22:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:22:21.183 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:21.183 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-17 04:22:10.733569603 +0000 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 04:20:16.063971576 +0000 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 04:20:16.063971576 +0000 2024-09-17T04:22:21.184 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-17 04:20:16.063971576 +0000 2024-09-17T04:22:21.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:22:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-17T04:22:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-17T04:22:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000252171 s, 2.0 MB/s 2024-09-17T04:22:21.249 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:22:21.307 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-17T04:22:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:22:21.363 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-17 04:22:10.733569603 +0000 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 04:20:16.396968041 +0000 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 04:20:16.396968041 +0000 2024-09-17T04:22:21.364 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-17 04:20:16.396968041 +0000 2024-09-17T04:22:21.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:22:21.427 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-17T04:22:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-17T04:22:21.428 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00021599 s, 2.4 MB/s 2024-09-17T04:22:21.429 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:22:21.486 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-17T04:22:21.542 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:22:21.542 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:21.542 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T04:22:21.542 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:21.543 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:21.543 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-17 04:22:10.734569592 +0000 2024-09-17T04:22:21.543 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 04:20:16.722964581 +0000 2024-09-17T04:22:21.543 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 04:20:16.722964581 +0000 2024-09-17T04:22:21.543 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-17 04:20:16.722964581 +0000 2024-09-17T04:22:21.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:22:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-17T04:22:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-17T04:22:21.608 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000289148 s, 1.8 MB/s 2024-09-17T04:22:21.609 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:22:21.666 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-17 04:22:10.734569592 +0000 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 04:20:17.066960930 +0000 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 04:20:17.066960930 +0000 2024-09-17T04:22:21.722 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-17 04:20:17.066960930 +0000 2024-09-17T04:22:21.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:22:21.789 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-17T04:22:21.789 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-17T04:22:21.789 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000188486 s, 2.7 MB/s 2024-09-17T04:22:21.789 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:22:21.846 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:21.846 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:21.846 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T04:22:21.863 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T04:22:21.863 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-17T04:22:21.920 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-17 04:22:07.310264557 +0000 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-17 04:20:10.659954428 +0000 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-17 04:20:10.659954428 +0000 2024-09-17T04:22:21.921 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-17 04:20:10.659954428 +0000 2024-09-17T04:22:21.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T04:22:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-17T04:22:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-17T04:22:21.985 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000205243 s, 2.5 MB/s 2024-09-17T04:22:21.987 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T04:22:22.044 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-17T04:22:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T04:22:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-17 04:22:07.311264531 +0000 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-17 04:20:11.001945257 +0000 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-17 04:20:11.001945257 +0000 2024-09-17T04:22:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-17 04:20:11.001945257 +0000 2024-09-17T04:22:22.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T04:22:22.164 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-17T04:22:22.165 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-17T04:22:22.165 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000191468 s, 2.7 MB/s 2024-09-17T04:22:22.166 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T04:22:22.222 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-17T04:22:22.278 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T04:22:22.278 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:22.278 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T04:22:22.278 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:22.279 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:22.279 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-17 04:22:07.311264531 +0000 2024-09-17T04:22:22.279 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-17 04:20:11.333936355 +0000 2024-09-17T04:22:22.279 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-17 04:20:11.333936355 +0000 2024-09-17T04:22:22.279 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-17 04:20:11.333936355 +0000 2024-09-17T04:22:22.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T04:22:22.342 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-17T04:22:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-17T04:22:22.343 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000202618 s, 2.5 MB/s 2024-09-17T04:22:22.344 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T04:22:22.400 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-17T04:22:22.456 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T04:22:22.456 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T04:22:22.456 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T04:22:22.456 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:22:22.457 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T04:22:22.457 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-17 04:22:07.312264504 +0000 2024-09-17T04:22:22.457 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-17 04:20:11.644928016 +0000 2024-09-17T04:22:22.457 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-17 04:20:11.644928016 +0000 2024-09-17T04:22:22.457 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: 2024-09-17 04:20:11.644928016 +0000 2024-09-17T04:22:22.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T04:22:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-17T04:22:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-17T04:22:22.520 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000288549 s, 1.8 MB/s 2024-09-17T04:22:22.521 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T04:22:22.578 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:22.578 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:22:22.578 INFO:tasks.ceph:Generating config... 2024-09-17T04:22:22.580 INFO:tasks.ceph:[client] pid file = 2024-09-17T04:22:22.580 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T04:22:22.580 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T04:22:22.580 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T04:22:22.580 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T04:22:22.580 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T04:22:22.580 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T04:22:22.580 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T04:22:22.581 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T04:22:22.581 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T04:22:22.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T04:22:22.649 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T04:22:22.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T04:22:22.706 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:22:22.731 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]')] 2024-09-17T04:22:22.732 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T04:22:22.733 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:22.733 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:22:22.787 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 2184e050-2c9d-47fc-8e14-c53eccd8cf79 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 2184e050-2c9d-47fc-8e14-c53eccd8cf79 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-17T04:22:22.888160+0000 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-17T04:22:22.888160+0000 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.b 2024-09-17T04:22:22.887 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-09-17T04:22:22.888 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T04:22:22.889 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T04:22:22.904 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2184e050-2c9d-47fc-8e14-c53eccd8cf79... 2024-09-17T04:22:22.905 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:22:22.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-17T04:22:22.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:22:22.990 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-17T04:22:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-17T04:22:22.992 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 2184e050-2c9d-47fc-8e14-c53eccd8cf79 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.993 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.994 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-17T04:22:22.995 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T04:22:22.996 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-17T04:22:22.997 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.998 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: mon down mkfs grace = 300 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-17T04:22:22.999 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-17T04:22:23.000 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-17T04:22:23.001 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-17T04:22:23.002 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.003 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.63,172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790]" 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on skipped message = False 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 2184e050-2c9d-47fc-8e14-c53eccd8cf79 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-17T04:22:23.004 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.005 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-09-17T04:22:23.006 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-17T04:22:23.007 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-17T04:22:23.008 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.009 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: mon down mkfs grace = 300 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = "" 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-17T04:22:23.010 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-17T04:22:23.011 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-17T04:22:23.011 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-17T04:22:23.011 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-17T04:22:23.011 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-17T04:22:23.012 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T04:22:23.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T04:22:23.118 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T04:22:23.118 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:23.118 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T04:22:23.134 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:23.134 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T04:22:23.190 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:22:23.190 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:23.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:22:23.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:22:23.265 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:23.266 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:23.322 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:22:23.322 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:23.322 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T04:22:23.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T04:22:23.357 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:23.357 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:23.413 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T04:22:23.413 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T04:22:23.414 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:22:23.476 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T04:22:23.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:22:23.559 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T04:22:23.562 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T04:22:23.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:22:23.624 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T04:22:23.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T04:22:23.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:22:23.757 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T04:22:23.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T04:22:23.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:22:23.847 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T04:22:23.850 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T04:22:23.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:22:23.975 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T04:22:23.978 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T04:22:24.002 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T04:22:24.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T04:22:24.054 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T04:22:24.068 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T04:22:24.120 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T04:22:24.133 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T04:22:24.183 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T04:22:24.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T04:22:24.247 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T04:22:24.261 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T04:22:24.261 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T04:22:24.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T04:22:24.287 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:24.287 INFO:tasks.ceph:role: osd.0 2024-09-17T04:22:24.287 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:22:24.287 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:22:24.360 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:24.360 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:24.361 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:24.846 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-17T04:22:24.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-17T04:22:24.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T04:22:24.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T04:22:24.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T04:22:25.062 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:25.062 INFO:tasks.ceph:role: osd.1 2024-09-17T04:22:25.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:22:25.062 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:22:25.136 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:25.137 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:25.586 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-17T04:22:25.588 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-17T04:22:25.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T04:22:25.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T04:22:25.733 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T04:22:25.799 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:25.799 INFO:tasks.ceph:role: osd.2 2024-09-17T04:22:25.799 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:22:25.799 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:22:25.873 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:25.874 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:25.875 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:25.875 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:25.875 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:26.359 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-17T04:22:26.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-17T04:22:26.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T04:22:26.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T04:22:26.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T04:22:26.554 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:26.554 INFO:tasks.ceph:role: osd.3 2024-09-17T04:22:26.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:22:26.554 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:22:26.627 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:26.628 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:27.145 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-17T04:22:27.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-17T04:22:27.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T04:22:27.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T04:22:27.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:27.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:27.419+0000 7ff9f88da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T04:22:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:27.421+0000 7ff9f88da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T04:22:27.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:27.421+0000 7ff9f88da640 -1 bdev(0x5573c0fcd900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:27.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:27.421+0000 7ff9f88da640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T04:22:30.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T04:22:30.863 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:30.967+0000 7f5fe4a2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T04:22:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:30.967+0000 7f5fe4a2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T04:22:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:30.967+0000 7f5fe4a2e640 -1 bdev(0x560ff71bf900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:30.967+0000 7f5fe4a2e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T04:22:33.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T04:22:33.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:34.018+0000 7f3ab4e33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T04:22:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:34.018+0000 7f3ab4e33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T04:22:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:34.018+0000 7f3ab4e33640 -1 bdev(0x560b5425b900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:34.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:34.018+0000 7f3ab4e33640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T04:22:36.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T04:22:36.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:37.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:37.058+0000 7f345b220640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T04:22:37.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:37.058+0000 7f345b220640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T04:22:37.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:37.058+0000 7f345b220640 -1 bdev(0x555b7d0ed900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:37.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:22:37.058+0000 7f345b220640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T04:22:40.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T04:22:40.508 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T04:22:40.538 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:40.538 INFO:tasks.ceph:role: osd.4 2024-09-17T04:22:40.538 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:22:40.538 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T04:22:40.613 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:40.614 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:41.141 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-17T04:22:41.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-17T04:22:41.143 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T04:22:41.272 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T04:22:41.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T04:22:41.369 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:41.369 INFO:tasks.ceph:role: osd.5 2024-09-17T04:22:41.369 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:22:41.369 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T04:22:41.441 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:41.441 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:41.441 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:41.441 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:41.441 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:41.442 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:41.442 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:41.442 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:41.442 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:41.442 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:41.901 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-17T04:22:41.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-17T04:22:41.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T04:22:41.989 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T04:22:42.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T04:22:42.081 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:42.081 INFO:tasks.ceph:role: osd.6 2024-09-17T04:22:42.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:22:42.081 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:42.154 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:42.155 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:42.155 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:42.155 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:42.155 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:42.647 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-17T04:22:42.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-17T04:22:42.649 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T04:22:42.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T04:22:42.828 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T04:22:42.892 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T04:22:42.893 INFO:tasks.ceph:role: osd.7 2024-09-17T04:22:42.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:22:42.893 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T04:22:42.964 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T04:22:42.964 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T04:22:42.965 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T04:22:43.454 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-17T04:22:43.456 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-17T04:22:43.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T04:22:43.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T04:22:43.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:43.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:43.751+0000 7f857d156640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T04:22:43.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:43.751+0000 7f857d156640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T04:22:43.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:43.751+0000 7f857d156640 -1 bdev(0x55d6c9473900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:43.751 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:43.751+0000 7f857d156640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T04:22:46.662 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T04:22:46.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:46.795 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:46.795+0000 7fe0620e0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T04:22:46.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:46.795+0000 7fe0620e0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T04:22:46.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:46.796+0000 7fe0620e0640 -1 bdev(0x55c8b9173900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:46.796 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:46.796+0000 7fe0620e0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T04:22:49.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T04:22:49.729 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:49.831 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:49.831+0000 7fa039415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T04:22:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:49.832+0000 7fa039415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T04:22:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:49.832+0000 7fa039415640 -1 bdev(0x562f7d33b900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:49.832 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:49.832+0000 7fa039415640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T04:22:50.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:50.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:22:53.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T04:22:53.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:53.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:53.383+0000 7f318ac0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T04:22:53.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:53.383+0000 7f318ac0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T04:22:53.383 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:53.383+0000 7f318ac0f640 -1 bdev(0x5581b2c5f900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T04:22:53.384 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:22:53.383+0000 7f318ac0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T04:22:56.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T04:22:56.828 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T04:22:56.829 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:56.829 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T04:22:56.861 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:56.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T04:22:56.930 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:56.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T04:22:56.999 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:56.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T04:22:57.068 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:57.068 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T04:22:57.136 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:57.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T04:22:57.204 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:57.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T04:22:57.270 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.270 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T04:22:57.300 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T04:22:57.368 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T04:22:57.435 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T04:22:57.502 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T04:22:57.569 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.569 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T04:22:57.635 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.635 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T04:22:57.700 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:57.700 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T04:22:57.716 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:22:57.717 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T04:22:57.772 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.772 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T04:22:57.789 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:22:57.789 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T04:22:57.844 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T04:22:57.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:22:57.846 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T04:22:57.888 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lm9f51HBAA+JtOYZ6YXWmFDfTnreC97Q== 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lm4z1TJRAAcY7YA3PrBlxgCe/VRLYmHg== 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lmtG09LRAA5SCBQMugKdve1KWPgNC0eg== 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQADBOlm4iwLGRAAdGecgArgUSGrSEqYjjWrbQ== 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAGBOlmLzm4ORAAWAzT9Y4Py1pDcTvKgc0oaQ== 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-17T04:22:57.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAKBOlmMhwlARAAyt46K3FOqY+0+HbIUalBOw== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQANBOlm4VmKAxAA7ze24+GgewESsED6zrHBaQ== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lmFNltIRAAH8WlMWU//jUaR5ovDIGE6Q== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lmP2aTMhAAbr6riE9JzM153ba6SEtGQQ== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lmJ5AzOhAAtli+UjX+PbvUkeGDsFwAnA== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQATBOlmtS7ULBAAiOldufc0GuUYVmAjITowdA== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAWBOlmVJ18LxAAa3IAzRRrr1wnoA6st8IGyg== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAZBOlmUyGjMRAA0usCei49wb5QsnmdyztD/Q== 2024-09-17T04:22:57.890 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAdBOlmYCTrFhAAMc+SF/AcrOnWfyl/r7UFqQ== 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAABOlmlR9ZAxAAdELUblUr9QUs6iP5eoCjMw== 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout:[client.2] 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAABOlmI483BxAABYQRLW0//iWUCyOulmq3UA== 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAABOlmmEoKCxAAy4NsGtfOnDQfNlwhB88xxw== 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout:[client.3] 2024-09-17T04:22:57.891 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAABOlmRoHNDhAAKzZpSJctr+VpYCv9RqPTEQ== 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lm9f51HBAA+JtOYZ6YXWmFDfTnreC97Q== 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lm4z1TJRAAcY7YA3PrBlxgCe/VRLYmHg== 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.c] 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lmtG09LRAA5SCBQMugKdve1KWPgNC0eg== 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQADBOlm4iwLGRAAdGecgArgUSGrSEqYjjWrbQ== 2024-09-17T04:22:57.908 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAGBOlmLzm4ORAAWAzT9Y4Py1pDcTvKgc0oaQ== 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAKBOlmMhwlARAAyt46K3FOqY+0+HbIUalBOw== 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQANBOlm4VmKAxAA7ze24+GgewESsED6zrHBaQ== 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lmFNltIRAAH8WlMWU//jUaR5ovDIGE6Q== 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.b] 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lmP2aTMhAAbr6riE9JzM153ba6SEtGQQ== 2024-09-17T04:22:57.909 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.d] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQD/A+lmJ5AzOhAAtli+UjX+PbvUkeGDsFwAnA== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQATBOlmtS7ULBAAiOldufc0GuUYVmAjITowdA== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAWBOlmVJ18LxAAa3IAzRRrr1wnoA6st8IGyg== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAZBOlmUyGjMRAA0usCei49wb5QsnmdyztD/Q== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAdBOlmYCTrFhAAMc+SF/AcrOnWfyl/r7UFqQ== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAABOlmlR9ZAxAAdELUblUr9QUs6iP5eoCjMw== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[client.2] 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAABOlmI483BxAABYQRLW0//iWUCyOulmq3UA== 2024-09-17T04:22:57.910 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-17T04:22:57.911 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAABOlmmEoKCxAAy4NsGtfOnDQfNlwhB88xxw== 2024-09-17T04:22:57.911 INFO:teuthology.orchestra.run.smithi112.stdout:[client.3] 2024-09-17T04:22:57.911 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQAABOlmRoHNDhAAKzZpSJctr+VpYCv9RqPTEQ== 2024-09-17T04:22:57.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:22:57.935 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:22:58.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.083 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.212 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.275 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.339 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:22:58.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T04:22:58.463 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.532 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T04:22:58.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.726 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.791 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T04:22:58.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:58.855 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:58.919 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:58.922 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:58.985 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:58.988 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:59.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:59.055 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T04:22:59.119 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T04:22:59.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T04:22:59.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:22:59.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T04:22:59.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T04:22:59.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:22:59.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T04:22:59.435 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T04:22:59.500 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T04:22:59.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T04:22:59.632 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:59.634 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T04:22:59.687 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T04:22:59.688 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T04:22:59.688 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T04:22:59.690 INFO:tasks.ceph.mon.a:Started 2024-09-17T04:22:59.691 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T04:22:59.691 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T04:22:59.730 INFO:tasks.ceph.mon.b:Started 2024-09-17T04:22:59.730 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T04:22:59.730 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T04:22:59.732 INFO:tasks.ceph.mon.c:Started 2024-09-17T04:22:59.732 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T04:22:59.732 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T04:22:59.732 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T04:22:59.734 INFO:tasks.ceph.mgr.y:Started 2024-09-17T04:22:59.734 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T04:22:59.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T04:22:59.736 INFO:tasks.ceph.mgr.x:Started 2024-09-17T04:22:59.737 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T04:22:59.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T04:22:59.739 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T04:22:59.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T04:22:59.781 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T04:22:59.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T04:22:59.824 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T04:22:59.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T04:22:59.867 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T04:22:59.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T04:22:59.910 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T04:22:59.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T04:22:59.955 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T04:22:59.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T04:22:59.998 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T04:22:59.998 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T04:23:00.042 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T04:23:00.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T04:23:00.089 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T04:23:00.089 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T04:23:00.145 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T04:23:00.145 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T04:23:00.189 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T04:23:00.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T04:23:00.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.227+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7d88005310 con 0x7f7db0153c00 2024-09-17T04:23:00.238 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T04:23:00.238 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.235+0000 7f9369ffb640 1 -- 172.21.15.63:0/2555734031 <== mon.1 v2:172.21.15.112:3300/0 10 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f936c0052a0 con 0x7f93740b5160 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 -- 172.21.15.63:0/2771682217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53280ca5c0 msgr2=0x7f53280ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 --2- 172.21.15.63:0/2771682217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53280ca5c0 0x7f53280ca9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53140057e0 tx=0x7f532000dd80 comp rx=0 tx=0).stop 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 -- 172.21.15.63:0/2771682217 shutdown_connections 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 --2- 172.21.15.63:0/2771682217 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f53280ca5c0 0x7f53280ca9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 --2- 172.21.15.63:0/2771682217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53280c5330 0x7f53280c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 --2- 172.21.15.63:0/2771682217 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5314004800 0x7f532806e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 -- 172.21.15.63:0/2771682217 >> 172.21.15.63:0/2771682217 conn(0x7f53280cedc0 msgr2=0x7f53280b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 -- 172.21.15.63:0/2771682217 shutdown_connections 2024-09-17T04:23:00.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7f532f78b640 1 -- 172.21.15.63:0/2771682217 wait complete. 2024-09-17T04:23:00.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.233+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf14005290 con 0x7fcf3406fe10 2024-09-17T04:23:00.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.236+0000 7fcf1bfff640 1 -- 172.21.15.63:0/3889569962 <== mon.1 v2:172.21.15.112:3300/0 6 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7fcf28010480 con 0x7fcf3406fe10 2024-09-17T04:23:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.242+0000 7f7dacff9640 1 -- 172.21.15.63:0/1436236457 <== mon.2 v2:172.21.15.112:3301/0 10 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f7da801d8b0 con 0x7f7db0153c00 2024-09-17T04:23:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.242+0000 7f7dacff9640 1 -- 172.21.15.63:0/1436236457 <== mon.2 v2:172.21.15.112:3301/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f7db015f9d0 con 0x7f7db0153c00 2024-09-17T04:23:00.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.240+0000 7f684ffff640 1 -- 172.21.15.63:0/658289781 <== mon.0 v2:172.21.15.63:3300/0 10 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f686000cb70 con 0x7f6868070d90 2024-09-17T04:23:00.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.238+0000 7fcf1bfff640 1 -- 172.21.15.63:0/3889569962 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcf2801e030 con 0x7fcf3406fe10 2024-09-17T04:23:00.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.244+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f934c0052f0 con 0x7f93740b5160 2024-09-17T04:23:00.245 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T04:23:00.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T04:23:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.251+0000 7fcf1bfff640 1 -- 172.21.15.63:0/3889569962 <== mon.1 v2:172.21.15.112:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf28010630 con 0x7fcf3406fe10 2024-09-17T04:23:00.256 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T04:23:00.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T04:23:00.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.251+0000 7f9369ffb640 1 -- 172.21.15.63:0/2555734031 <== mon.1 v2:172.21.15.112:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f936c033630 con 0x7f93740b5160 2024-09-17T04:23:00.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.251+0000 7f9369ffb640 1 -- 172.21.15.63:0/2555734031 <== mon.1 v2:172.21.15.112:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v6)=0 v6) ==== 114+0+0 (secure 0 0 0) 0x7f936c033a80 con 0x7f93740b5160 2024-09-17T04:23:00.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.252+0000 7f684ffff640 1 -- 172.21.15.63:0/658289781 <== mon.0 v2:172.21.15.63:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f686000cb70 con 0x7f6868070d90 2024-09-17T04:23:00.261 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T04:23:00.261 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T04:23:00.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.264+0000 7f7dacff9640 1 -- 172.21.15.63:0/1436236457 <== mon.2 v2:172.21.15.112:3301/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7da801c760 con 0x7f7db0153c00 2024-09-17T04:23:00.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0153c00 msgr2=0x7f7db00b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 --2- 172.21.15.63:0/1436236457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0153c00 0x7f7db00b3930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7db00c6cf0 tx=0x7f7da8006720 comp rx=0 tx=0).stop 2024-09-17T04:23:00.267 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T04:23:00.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 shutdown_connections 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 --2- 172.21.15.63:0/1436236457 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7db014f7a0 0x7f7db01536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 --2- 172.21.15.63:0/1436236457 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7db0153c00 0x7f7db00b3930 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 --2- 172.21.15.63:0/1436236457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d980037a0 0x7f7db0152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.265+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 >> 172.21.15.63:0/1436236457 conn(0x7f7db00cd480 msgr2=0x7f7db015c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.266+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 shutdown_connections 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.267+0000 7f7db698b640 1 -- 172.21.15.63:0/1436236457 wait complete. 2024-09-17T04:23:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.267+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740b5160 msgr2=0x7f937413c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.267+0000 7f937b8b6640 1 --2- 172.21.15.63:0/2555734031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740b5160 0x7f937413c840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f936c009ed0 tx=0x7f936c004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 shutdown_connections 2024-09-17T04:23:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 --2- 172.21.15.63:0/2555734031 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f93740b5160 0x7f937413c840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 --2- 172.21.15.63:0/2555734031 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f937414b890 0x7f93740b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 --2- 172.21.15.63:0/2555734031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93600040f0 0x7f9374152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 >> 172.21.15.63:0/2555734031 conn(0x7f93740cdc60 msgr2=0x7f937415edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.277 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T04:23:00.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T04:23:00.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 shutdown_connections 2024-09-17T04:23:00.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.275+0000 7f937b8b6640 1 -- 172.21.15.63:0/2555734031 wait complete. 2024-09-17T04:23:00.298 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T04:23:00.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T04:23:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.340+0000 7fdfb8e41640 1 -- 172.21.15.63:0/3066407910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf9c005cb0 msgr2=0x7fdf9c0060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.340+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/3066407910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf9c005cb0 0x7fdf9c0060e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4001670 tx=0x7fdf9c007a40 comp rx=0 tx=0).stop 2024-09-17T04:23:00.344 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T04:23:00.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T04:23:00.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.344+0000 7fdfb8e41640 1 -- 172.21.15.63:0/3066407910 shutdown_connections 2024-09-17T04:23:00.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.344+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/3066407910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf9c005cb0 0x7fdf9c0060e0 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4001670 tx=0x7fdf9c007a40 comp rx=0 tx=0).stop 2024-09-17T04:23:00.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.344+0000 7fdfb8e41640 1 -- 172.21.15.63:0/3066407910 >> 172.21.15.63:0/3066407910 conn(0x7fdfb40cd480 msgr2=0x7fdfb40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.355+0000 7fba152d3640 1 -- 172.21.15.63:0/1174684869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba1015ecd0 msgr2=0x7fba100cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.355+0000 7fba152d3640 1 --2- 172.21.15.63:0/1174684869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba1015ecd0 0x7fba100cb820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba00009860 tx=0x7fba0002a3b0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.357 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T04:23:00.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T04:23:00.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.351+0000 7fdfb8e41640 1 -- 172.21.15.63:0/3066407910 shutdown_connections 2024-09-17T04:23:00.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.351+0000 7fdfb8e41640 1 -- 172.21.15.63:0/3066407910 wait complete. 2024-09-17T04:23:00.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.354+0000 7fdfb8e41640 1 Processor -- start 2024-09-17T04:23:00.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.355+0000 7fdfb8e41640 1 -- start start 2024-09-17T04:23:00.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.359+0000 7fba152d3640 1 -- 172.21.15.63:0/1174684869 shutdown_connections 2024-09-17T04:23:00.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.359+0000 7fba152d3640 1 --2- 172.21.15.63:0/1174684869 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba1015ecd0 0x7fba100cb820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.359+0000 7fba152d3640 1 -- 172.21.15.63:0/1174684869 >> 172.21.15.63:0/1174684869 conn(0x7fba1006d5d0 msgr2=0x7fba1006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.359+0000 7fba152d3640 1 -- 172.21.15.63:0/1174684869 shutdown_connections 2024-09-17T04:23:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.363+0000 7fba152d3640 1 -- 172.21.15.63:0/1174684869 wait complete. 2024-09-17T04:23:00.372 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T04:23:00.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T04:23:00.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.366+0000 7fba152d3640 1 Processor -- start 2024-09-17T04:23:00.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.368+0000 7fba152d3640 1 -- start start 2024-09-17T04:23:00.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.357+0000 7fdfb8e41640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 0x7fdfb415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.357+0000 7fdfb8e41640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.359+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 0x7fdfb415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.360+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 0x7fdfb415bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48254/0 (socket says 172.21.15.63:48254) 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.369+0000 7fdfb1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.369+0000 7fdfb1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39034/0 (socket says 172.21.15.63:39034) 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.369+0000 7fdfb259c640 1 -- 172.21.15.63:0/1984251607 learned_addr learned my addr 172.21.15.63:0/1984251607 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.369+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 0x7fdfb4205740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb4075cf0 con 0x7fdfb415c130 2024-09-17T04:23:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40c5b10 con 0x7fdfb40ca5c0 2024-09-17T04:23:00.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb4075e70 con 0x7fdfb40b6720 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.373+0000 7fba152d3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba100c9da0 0x7fba10201ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.373+0000 7fba152d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba100ca1b0 0x7fba100ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.374+0000 7fba152d3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.374+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.374+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39050/0 (socket says 172.21.15.63:39050) 2024-09-17T04:23:00.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.374+0000 7fba0f7fe640 1 -- 172.21.15.63:0/3052586650 learned_addr learned my addr 172.21.15.63:0/3052586650 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.375+0000 7fba152d3640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba100ce3d0 con 0x7fba1015ecd0 2024-09-17T04:23:00.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.375+0000 7fba152d3640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fba100ce250 con 0x7fba100ca1b0 2024-09-17T04:23:00.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.375+0000 7fba152d3640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fba100ce550 con 0x7fba100c9da0 2024-09-17T04:23:00.379 DEBUG:tasks.ceph:set 22 configs 2024-09-17T04:23:00.379 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.380 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.380 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.380 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.380 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.380 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.378+0000 7fba0effd640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba100c9da0 0x7fba10201ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.379+0000 7fba0e7fc640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba100ca1b0 0x7fba100ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.379+0000 7fba0f7fe640 1 -- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba100c9da0 msgr2=0x7fba10201ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.379+0000 7fba0f7fe640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba100c9da0 0x7fba10201ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.380+0000 7fba0f7fe640 1 -- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba100ca1b0 msgr2=0x7fba100ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.380+0000 7fba0f7fe640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba100ca1b0 0x7fba100ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.380+0000 7fba0f7fe640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba10145770 con 0x7fba1015ecd0 2024-09-17T04:23:00.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.381+0000 7fba0f7fe640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c7a0 tx=0x7fba0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb2d9d640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 0x7fdfb4205740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb2d9d640 1 -- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 msgr2=0x7fdfb415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb2d9d640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 0x7fdfb415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.370+0000 7fdfb2d9d640 1 -- 172.21.15.63:0/1984251607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 msgr2=0x7fdfb40b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.383+0000 7fdfb2d9d640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.383+0000 7fdfb2d9d640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb40b45b0 con 0x7fdfb40b6720 2024-09-17T04:23:00.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.383+0000 7fdfb1d9b640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:00.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfb2d9d640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 0x7fdfb4205740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40c7410 tx=0x7fdfa80035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8005220 con 0x7fdfb40b6720 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfa80053c0 con 0x7fdfb40b6720 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80047a0 con 0x7fdfb40b6720 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb40b5a20 con 0x7fdfb40b6720 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.386+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb40b3ff0 con 0x7fdfb40b6720 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.385+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08003da0 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.385+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba08005070 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.385+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba080054c0 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.385+0000 7fba152d3640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba10202d40 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.385+0000 7fba152d3640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba10145120 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.388+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba08005660 con 0x7fba1015ecd0 2024-09-17T04:23:00.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.388+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba0801b900 con 0x7fba1015ecd0 2024-09-17T04:23:00.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.388+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfa801f060 con 0x7fdfb40b6720 2024-09-17T04:23:00.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.388+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdfa8021450 con 0x7fdfb40b6720 2024-09-17T04:23:00.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.388+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f0005290 con 0x7fba1015ecd0 2024-09-17T04:23:00.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.389+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf98005290 con 0x7fdfb40b6720 2024-09-17T04:23:00.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.393+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fba0800a5e0 con 0x7fba1015ecd0 2024-09-17T04:23:00.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.393+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdfa8018e20 con 0x7fdfb40b6720 2024-09-17T04:23:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.489+0000 7f684dffb640 1 -- 172.21.15.63:0/658289781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f686815c170 con 0x7f6868070d90 2024-09-17T04:23:00.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.497+0000 7f684ffff640 1 -- 172.21.15.63:0/658289781 <== mon.0 v2:172.21.15.63:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f68600145e0 con 0x7f6868070d90 2024-09-17T04:23:00.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.499+0000 7f686c93f640 1 -- 172.21.15.63:0/658289781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6868070d90 msgr2=0x7f686815d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.499+0000 7f686c93f640 1 --2- 172.21.15.63:0/658289781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6868070d90 0x7f686815d970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f686000b6f0 tx=0x7f686000bbb0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 -- 172.21.15.63:0/658289781 shutdown_connections 2024-09-17T04:23:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 --2- 172.21.15.63:0/658289781 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6868152560 0x7f68680b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 --2- 172.21.15.63:0/658289781 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6868152010 0x7f68680b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 --2- 172.21.15.63:0/658289781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6868070d90 0x7f686815d970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 -- 172.21.15.63:0/658289781 >> 172.21.15.63:0/658289781 conn(0x7f68680d1020 msgr2=0x7f686815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 -- 172.21.15.63:0/658289781 shutdown_connections 2024-09-17T04:23:00.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.500+0000 7f686c93f640 1 -- 172.21.15.63:0/658289781 wait complete. 2024-09-17T04:23:00.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.518+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fcf14005580 con 0x7fcf3406fe10 2024-09-17T04:23:00.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.524+0000 7fcf1bfff640 1 -- 172.21.15.63:0/3889569962 <== mon.1 v2:172.21.15.112:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7fcf34070760 con 0x7fcf3406fe10 2024-09-17T04:23:00.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.527+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf3406fe10 msgr2=0x7fcf34070220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.527+0000 7fcf39b8b640 1 --2- 172.21.15.63:0/3889569962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf3406fe10 0x7fcf34070220 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800cf70 tx=0x7fcf2800a670 comp rx=0 tx=0).stop 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.528+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 shutdown_connections 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.528+0000 7fcf39b8b640 1 --2- 172.21.15.63:0/3889569962 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcf3406fe10 0x7fcf34070220 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.528+0000 7fcf39b8b640 1 --2- 172.21.15.63:0/3889569962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf3415ff30 0x7fcf34205270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.528+0000 7fcf39b8b640 1 --2- 172.21.15.63:0/3889569962 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcf34073e70 0x7fcf3415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.528+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 >> 172.21.15.63:0/3889569962 conn(0x7fcf340cdc60 msgr2=0x7fcf340b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.541+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 shutdown_connections 2024-09-17T04:23:00.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.541+0000 7fcf39b8b640 1 -- 172.21.15.63:0/3889569962 wait complete. 2024-09-17T04:23:00.569 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.569 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.612+0000 7f90753c5640 1 -- 172.21.15.63:0/1666307880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90700b3230 msgr2=0x7f90700d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.612+0000 7f90753c5640 1 --2- 172.21.15.63:0/1666307880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90700b3230 0x7f90700d0340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9060009830 tx=0x7f906002a440 comp rx=0 tx=0).stop 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 -- 172.21.15.63:0/1666307880 shutdown_connections 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 --2- 172.21.15.63:0/1666307880 >> v2:172.21.15.112:3300/0 conn(0x7f90700b3640 0x7f90700d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 --2- 172.21.15.63:0/1666307880 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f90700b3230 0x7f90700d0340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 -- 172.21.15.63:0/1666307880 >> 172.21.15.63:0/1666307880 conn(0x7f9070070b20 msgr2=0x7f9070070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 -- 172.21.15.63:0/1666307880 shutdown_connections 2024-09-17T04:23:00.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.613+0000 7f90753c5640 1 -- 172.21.15.63:0/1666307880 wait complete. 2024-09-17T04:23:00.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.617+0000 7f90753c5640 1 Processor -- start 2024-09-17T04:23:00.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.617+0000 7f90753c5640 1 -- start start 2024-09-17T04:23:00.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.622+0000 7f90753c5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.624+0000 7ff27ad82640 1 -- 172.21.15.63:0/3592893876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff27415b1d0 msgr2=0x7ff27415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.624+0000 7ff27ad82640 1 --2- 172.21.15.63:0/3592893876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff27415b1d0 0x7ff27415b5e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff2740cae00 tx=0x7ff26c02a7e0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.627+0000 7ff27ad82640 1 -- 172.21.15.63:0/3592893876 shutdown_connections 2024-09-17T04:23:00.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.627+0000 7ff27ad82640 1 --2- 172.21.15.63:0/3592893876 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff27415b1d0 0x7ff27415b5e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.627+0000 7ff27ad82640 1 --2- 172.21.15.63:0/3592893876 >> v2:172.21.15.63:3300/0 conn(0x7ff274151e80 0x7ff2740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.627+0000 7ff27ad82640 1 -- 172.21.15.63:0/3592893876 >> 172.21.15.63:0/3592893876 conn(0x7ff274073400 msgr2=0x7ff274073810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.628+0000 7ff27ad82640 1 -- 172.21.15.63:0/3592893876 shutdown_connections 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f906ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f906ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39078/0 (socket says 172.21.15.63:39078) 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f906ffff640 1 -- 172.21.15.63:0/1423200521 learned_addr learned my addr 172.21.15.63:0/1423200521 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f90753c5640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 0x7f9070204bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f90753c5640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 0x7f907015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.628+0000 7ff27ad82640 1 -- 172.21.15.63:0/3592893876 wait complete. 2024-09-17T04:23:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f906f7fe640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 0x7f9070204bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.630+0000 7f90753c5640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f90700aeac0 con 0x7f90700b3640 2024-09-17T04:23:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.631+0000 7f90753c5640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f90700ae940 con 0x7f9070162d00 2024-09-17T04:23:00.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.631+0000 7f9074bc4640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 0x7f907015b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.631+0000 7f90753c5640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f90700aec40 con 0x7f9070202eb0 2024-09-17T04:23:00.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7ff27ad82640 1 Processor -- start 2024-09-17T04:23:00.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 -- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 msgr2=0x7f907015b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 0x7f907015b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 -- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 msgr2=0x7f9070204bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 0x7f9070204bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9070205110 con 0x7f90700b3640 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.632+0000 7f906ffff640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f906800cc10 tx=0x7f906800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.633+0000 7f906f7fe640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 0x7f9070204bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.633+0000 7f9074bc4640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 0x7f907015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.633+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068017070 con 0x7f90700b3640 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.634+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f906800ac30 con 0x7f90700b3640 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.634+0000 7f90753c5640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90700a98e0 con 0x7f90700b3640 2024-09-17T04:23:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.634+0000 7ff27ad82640 1 -- start start 2024-09-17T04:23:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.634+0000 7f90753c5640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90700ab580 con 0x7f90700b3640 2024-09-17T04:23:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.636+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068003970 con 0x7f90700b3640 2024-09-17T04:23:00.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.643+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f906801a070 con 0x7f90700b3640 2024-09-17T04:23:00.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.643+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9068012900 con 0x7f90700b3640 2024-09-17T04:23:00.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.644+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9050005290 con 0x7f90700b3640 2024-09-17T04:23:00.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.644+0000 7ff27ad82640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff27406ddf0 0x7ff2740ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.644+0000 7ff27ad82640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff274151e80 0x7ff2740b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.644+0000 7ff27ad82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.645+0000 7ff27ad82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2740761d0 con 0x7ff27415b1d0 2024-09-17T04:23:00.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.645+0000 7ff27ad82640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff274076050 con 0x7ff274151e80 2024-09-17T04:23:00.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.645+0000 7ff27ad82640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff274076350 con 0x7ff27406ddf0 2024-09-17T04:23:00.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.645+0000 7f1ad0964640 1 -- 172.21.15.63:0/3532142369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4008fa0 msgr2=0x7f1ac40557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.645+0000 7f1ad0964640 1 --2- 172.21.15.63:0/3532142369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4008fa0 0x7f1ac40557d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400e730 tx=0x7f1ab802a4b0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7f1ad0964640 1 -- 172.21.15.63:0/3532142369 shutdown_connections 2024-09-17T04:23:00.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7f1ad0964640 1 --2- 172.21.15.63:0/3532142369 >> v2:172.21.15.63:3300/0 conn(0x7f1ac4055d10 0x7f1ac4053410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7f1ad0964640 1 --2- 172.21.15.63:0/3532142369 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4008fa0 0x7f1ac40557d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7f1ad0964640 1 --2- 172.21.15.63:0/3532142369 >> v2:172.21.15.112:3300/0 conn(0x7f1ac403ae90 0x7f1ac40dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7f1ad0964640 1 -- 172.21.15.63:0/3532142369 >> 172.21.15.63:0/3532142369 conn(0x7f1ac401eae0 msgr2=0x7f1ac403a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7ff27931f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7ff27931f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39102/0 (socket says 172.21.15.63:39102) 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.646+0000 7ff27931f640 1 -- 172.21.15.63:0/3522114388 learned_addr learned my addr 172.21.15.63:0/3522114388 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.647+0000 7ff27931f640 1 -- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff27406ddf0 msgr2=0x7ff2740ca5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.647+0000 7ff27931f640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff27406ddf0 0x7ff2740ca5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.647+0000 7ff27931f640 1 -- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff274151e80 msgr2=0x7ff2740b4bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.647+0000 7ff27931f640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff274151e80 0x7ff2740b4bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.647+0000 7ff27931f640 1 -- 172.21.15.63:0/3522114388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2740b5790 con 0x7ff27415b1d0 2024-09-17T04:23:00.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.648+0000 7f1ad0964640 1 -- 172.21.15.63:0/3532142369 shutdown_connections 2024-09-17T04:23:00.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.648+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9068003b10 con 0x7f90700b3640 2024-09-17T04:23:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.648+0000 7f1ad0964640 1 -- 172.21.15.63:0/3532142369 wait complete. 2024-09-17T04:23:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.651+0000 7f1ad0964640 1 Processor -- start 2024-09-17T04:23:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7f1ad0964640 1 -- start start 2024-09-17T04:23:00.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7fade7fc6640 1 -- 172.21.15.63:0/742168226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade00cac60 msgr2=0x7fade00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7fade7fc6640 1 --2- 172.21.15.63:0/742168226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade00cac60 0x7fade00cb070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fade00cbd50 tx=0x7fadd802ac40 comp rx=0 tx=0).stop 2024-09-17T04:23:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7fade7fc6640 1 -- 172.21.15.63:0/742168226 shutdown_connections 2024-09-17T04:23:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7fade7fc6640 1 --2- 172.21.15.63:0/742168226 >> v2:172.21.15.112:3300/0 conn(0x7fade00cc630 0x7fade00cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.652+0000 7fade7fc6640 1 --2- 172.21.15.63:0/742168226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade00cac60 0x7fade00cb070 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.653+0000 7fade7fc6640 1 -- 172.21.15.63:0/742168226 >> 172.21.15.63:0/742168226 conn(0x7fade006d5d0 msgr2=0x7fade006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ac403ae90 0x7f1ac40d42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4055d10 0x7f1ac4179c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39106/0 (socket says 172.21.15.63:39106) 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4052dc0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1acb7fe640 1 -- 172.21.15.63:0/1471880944 learned_addr learned my addr 172.21.15.63:0/1471880944 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4052c40 con 0x7f1ac403ae90 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.654+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac4053950 con 0x7f1ac4055d10 2024-09-17T04:23:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.655+0000 7f1acb7fe640 1 -- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4055d10 msgr2=0x7f1ac4179c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.655+0000 7f1acb7fe640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4055d10 0x7f1ac4179c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.655+0000 7f1acb7fe640 1 -- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ac403ae90 msgr2=0x7f1ac40d42d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.655+0000 7f1acb7fe640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ac403ae90 0x7f1ac40d42d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.655+0000 7f1acb7fe640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac40e0ff0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.656+0000 7f1acb7fe640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ac001f7a0 tx=0x7f1ac001fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.656+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac001dc70 con 0x7f1ac4008fa0 2024-09-17T04:23:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.656+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ac001fe50 con 0x7f1ac4008fa0 2024-09-17T04:23:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.656+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0021680 con 0x7f1ac4008fa0 2024-09-17T04:23:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.658+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac40e12d0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.648+0000 7ff27931f640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009f30 tx=0x7ff26c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.660+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c042030 con 0x7ff27415b1d0 2024-09-17T04:23:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.660+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff26c0077a0 con 0x7ff27415b1d0 2024-09-17T04:23:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.661+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c036040 con 0x7ff27415b1d0 2024-09-17T04:23:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.661+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac40c9b20 con 0x7f1ac4008fa0 2024-09-17T04:23:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.661+0000 7ff27ad82640 1 -- 172.21.15.63:0/3522114388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2740b5a70 con 0x7ff27415b1d0 2024-09-17T04:23:00.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.662+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff26c045070 con 0x7ff27415b1d0 2024-09-17T04:23:00.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.662+0000 7ff27ad82640 1 -- 172.21.15.63:0/3522114388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2740b6030 con 0x7ff27415b1d0 2024-09-17T04:23:00.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.663+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff26c004380 con 0x7ff27415b1d0 2024-09-17T04:23:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.664+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2740cf2a0 con 0x7ff27415b1d0 2024-09-17T04:23:00.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.666+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ac0021820 con 0x7f1ac4008fa0 2024-09-17T04:23:00.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1ac00323f0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.668+0000 7f1ab5ffb640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac4056590 con 0x7f1ac4008fa0 2024-09-17T04:23:00.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.669+0000 7f5d4c64d640 1 -- 172.21.15.63:0/683585294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 msgr2=0x7f5d4408b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.669+0000 7f5d4c64d640 1 --2- 172.21.15.63:0/683585294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d4408b2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c005fd0 tx=0x7f5d3c02a740 comp rx=0 tx=0).stop 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7f5f07b50640 1 -- 172.21.15.63:0/2822398805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f00174240 msgr2=0x7f5f00176660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7f5f07b50640 1 --2- 172.21.15.63:0/2822398805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f00174240 0x7f5f00176660 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009740 tx=0x7f5ef002c6b0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7f5f07b50640 1 -- 172.21.15.63:0/2822398805 shutdown_connections 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.653+0000 7fade7fc6640 1 -- 172.21.15.63:0/742168226 shutdown_connections 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.653+0000 7fade7fc6640 1 -- 172.21.15.63:0/742168226 wait complete. 2024-09-17T04:23:00.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.663+0000 7fade7fc6640 1 Processor -- start 2024-09-17T04:23:00.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7f5f07b50640 1 --2- 172.21.15.63:0/2822398805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f00174240 0x7f5f00176660 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7f5f07b50640 1 -- 172.21.15.63:0/2822398805 >> 172.21.15.63:0/2822398805 conn(0x7f5f0006d5d0 msgr2=0x7f5f0006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.663+0000 7fade7fc6640 1 -- start start 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.665+0000 7fade7fc6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade5d62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade5d62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39122/0 (socket says 172.21.15.63:39122) 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade5d62640 1 -- 172.21.15.63:0/3718882912 learned_addr learned my addr 172.21.15.63:0/3718882912 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade7fc6640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fade00cc630 0x7fade00b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade7fc6640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fade00b2850 0x7fade016d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.671+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff26c004580 con 0x7ff27415b1d0 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade7fc6640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fade00cd100 con 0x7fade0074640 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade7fc6640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fade00ccf80 con 0x7fade00cc630 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.667+0000 7fade7fc6640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fade00cd280 con 0x7fade00b2850 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 -- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fade00b2850 msgr2=0x7fade016d3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fade00b2850 0x7fade016d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 -- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fade00cc630 msgr2=0x7fade00b2310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fade00cc630 0x7fade00b2310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00b0ff0 con 0x7fade0074640 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.670+0000 7fade5d62640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faddc00b780 tx=0x7faddc00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.672+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc019070 con 0x7fade0074640 2024-09-17T04:23:00.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.672+0000 7fade7fc6640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00b12d0 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.672+0000 7fade7fc6640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade00b1890 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.674+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faddc00c830 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.674+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade00c8c50 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.674+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc00cc80 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.674+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faddc01c070 con 0x7fade0074640 2024-09-17T04:23:00.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.674+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faddc014860 con 0x7fade0074640 2024-09-17T04:23:00.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.675+0000 7f5f07b50640 1 -- 172.21.15.63:0/2822398805 shutdown_connections 2024-09-17T04:23:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.681+0000 7f5d4c64d640 1 -- 172.21.15.63:0/683585294 shutdown_connections 2024-09-17T04:23:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.681+0000 7f5d4c64d640 1 --2- 172.21.15.63:0/683585294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d4408b2c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.681+0000 7f5d4c64d640 1 -- 172.21.15.63:0/683585294 >> 172.21.15.63:0/683585294 conn(0x7f5d4406d5d0 msgr2=0x7f5d4406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fade00c8c50 con 0x7fade0074640 2024-09-17T04:23:00.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1ac0021b10 con 0x7f1ac4008fa0 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.675+0000 7f5f07b50640 1 -- 172.21.15.63:0/2822398805 wait complete. 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.678+0000 7f5f07b50640 1 Processor -- start 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.678+0000 7f5f07b50640 1 -- start start 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.680+0000 7f5f07b50640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 0x7f5f000b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.680+0000 7f5f07b50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f050eb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f050eb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39134/0 (socket says 172.21.15.63:39134) 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f058ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 0x7f5f000b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f050eb640 1 -- 172.21.15.63:0/246967297 learned_addr learned my addr 172.21.15.63:0/246967297 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f07b50640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f0015d4c0 0x7f5f0015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00176ba0 con 0x7f5f000cac60 2024-09-17T04:23:00.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000cd750 con 0x7f5f00074640 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.682+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5f00176d20 con 0x7f5f0015d4c0 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 -- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f0015d4c0 msgr2=0x7f5f0015d8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f0015d4c0 0x7f5f0015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 -- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 msgr2=0x7f5f000b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 0x7f5f000b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0015de10 con 0x7f5f000cac60 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f050eb640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800cb30 tx=0x7f5ef800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.684+0000 7f5f058ec640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 0x7f5f000b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.685+0000 7f5d4c64d640 1 -- 172.21.15.63:0/683585294 shutdown_connections 2024-09-17T04:23:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.685+0000 7f5d4c64d640 1 -- 172.21.15.63:0/683585294 wait complete. 2024-09-17T04:23:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.688+0000 7f5d4c64d640 1 Processor -- start 2024-09-17T04:23:00.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.688+0000 7f5d4c64d640 1 -- start start 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.686+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8017070 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.686+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f00164a50 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.686+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f00165010 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.686+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ef8003c60 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.687+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800aad0 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.688+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ef801a070 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.688+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ef801c780 con 0x7f5f000cac60 2024-09-17T04:23:00.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.690+0000 7f5d4c64d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d440c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.691+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee8005290 con 0x7f5f000cac60 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.691+0000 7f5d4c64d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 0x7f5d440c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.691+0000 7f5d4a3e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d440c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.691+0000 7f5d4a3e9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d440c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48368/0 (socket says 172.21.15.63:48368) 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.691+0000 7f5d4a3e9640 1 -- 172.21.15.63:0/1117139506 learned_addr learned my addr 172.21.15.63:0/1117139506 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.692+0000 7f5d49be8640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 0x7f5d440c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.692+0000 7f5d4c64d640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 0x7f5d4420e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.692+0000 7f5d4c64d640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5d440cd110 con 0x7f5d4408b800 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7fa629ef9640 1 -- 172.21.15.63:0/1747376155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60c0099b0 msgr2=0x7fa60c00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7fa629ef9640 1 --2- 172.21.15.63:0/1747376155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60c0099b0 0x7fa60c00bdd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6240d0ef0 tx=0x7fa60c005830 comp rx=0 tx=0).stop 2024-09-17T04:23:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7f5d4abea640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 0x7f5d4420e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7fa629ef9640 1 -- 172.21.15.63:0/1747376155 shutdown_connections 2024-09-17T04:23:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7fa629ef9640 1 --2- 172.21.15.63:0/1747376155 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa60c0099b0 0x7fa60c00bdd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7fa629ef9640 1 -- 172.21.15.63:0/1747376155 >> 172.21.15.63:0/1747376155 conn(0x7fa62406d5d0 msgr2=0x7fa62406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7f5d4c64d640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5d440ccf90 con 0x7f5d44074640 2024-09-17T04:23:00.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.693+0000 7f5d4c64d640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5d440cd290 con 0x7f5d4420dd60 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 -- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 msgr2=0x7f5d4420e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 0x7f5d4420e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 -- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 msgr2=0x7f5d440c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d440c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4420e6b0 con 0x7f5d4408b800 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d49be8640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 0x7f5d440c4e90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c460 tx=0x7f5d4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.694+0000 7f5d4abea640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 0x7f5d4420e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.695+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40017070 con 0x7f5d4408b800 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.695+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d400035f0 con 0x7f5d4408b800 2024-09-17T04:23:00.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.696+0000 7f5d4c64d640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d440c9fc0 con 0x7f5d4408b800 2024-09-17T04:23:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.696+0000 7fa629ef9640 1 -- 172.21.15.63:0/1747376155 shutdown_connections 2024-09-17T04:23:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.696+0000 7f5d4c64d640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d440c8fa0 con 0x7f5d4408b800 2024-09-17T04:23:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.698+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40003a40 con 0x7f5d4408b800 2024-09-17T04:23:00.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.698+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d4001a070 con 0x7f5d4408b800 2024-09-17T04:23:00.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.698+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d4001c780 con 0x7f5d4408b800 2024-09-17T04:23:00.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.698+0000 7f48df8de640 1 -- 172.21.15.63:0/633862249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d815ec80 msgr2=0x7f48d815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.698+0000 7f48df8de640 1 --2- 172.21.15.63:0/633862249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d815ec80 0x7f48d815f090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005fd0 tx=0x7f48d002aae0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.699+0000 7f48df8de640 1 -- 172.21.15.63:0/633862249 shutdown_connections 2024-09-17T04:23:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.699+0000 7f48df8de640 1 --2- 172.21.15.63:0/633862249 >> v2:172.21.15.63:3300/0 conn(0x7f48d815f5d0 0x7f48d80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.699+0000 7f48df8de640 1 --2- 172.21.15.63:0/633862249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d815ec80 0x7f48d815f090 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.699+0000 7f48df8de640 1 -- 172.21.15.63:0/633862249 >> 172.21.15.63:0/633862249 conn(0x7f48d80b1c20 msgr2=0x7f48d80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.700+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5ef800ac70 con 0x7f5f000cac60 2024-09-17T04:23:00.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.704+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c005290 con 0x7f5d4408b800 2024-09-17T04:23:00.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.700+0000 7fa629ef9640 1 -- 172.21.15.63:0/1747376155 wait complete. 2024-09-17T04:23:00.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.703+0000 7fa629ef9640 1 Processor -- start 2024-09-17T04:23:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.704+0000 7f48df8de640 1 -- 172.21.15.63:0/633862249 shutdown_connections 2024-09-17T04:23:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7f48df8de640 1 -- 172.21.15.63:0/633862249 wait complete. 2024-09-17T04:23:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.708+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5d4420e6b0 con 0x7f5d4408b800 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.709+0000 7fa629ef9640 1 -- start start 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.711+0000 7fa629ef9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.711+0000 7fa629ef9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39168/0 (socket says 172.21.15.63:39168) 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48380/0 (socket says 172.21.15.63:48380) 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa622ffd640 1 -- 172.21.15.63:0/3646877617 learned_addr learned my addr 172.21.15.63:0/3646877617 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa629ef9640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 0x7fa62415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa629ef9640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240d0440 con 0x7fa624074000 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa629ef9640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240d02c0 con 0x7fa624142810 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa623fff640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 0x7fa62415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.712+0000 7fa629ef9640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6240d05c0 con 0x7fa62412fbe0 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.714+0000 7f48df8de640 1 Processor -- start 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.715+0000 7f48df8de640 1 -- start start 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 -- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 msgr2=0x7fa62415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 0x7fa62415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 -- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 msgr2=0x7fa624158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa624072c80 con 0x7fa624074000 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa622ffd640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0018c0 tx=0x7fa61c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.716+0000 7fa6237fe640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7fa623fff640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 0x7fa62415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d806f390 0x7f48d813bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d815f5d0 0x7f48d80d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80cbe30 con 0x7f48d815ec80 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80cbcb0 con 0x7f48d815f5d0 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.717+0000 7f48df8de640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f48d80cbfb0 con 0x7f48d806f390 2024-09-17T04:23:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.718+0000 7f48dce79640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.718+0000 7f48dce79640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39172/0 (socket says 172.21.15.63:39172) 2024-09-17T04:23:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.718+0000 7f48dce79640 1 -- 172.21.15.63:0/798225553 learned_addr learned my addr 172.21.15.63:0/798225553 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.718+0000 7f48dce79640 1 -- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d806f390 msgr2=0x7f48d813bb10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.719+0000 7f48dce79640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d806f390 0x7f48d813bb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.719+0000 7f48dce79640 1 -- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d815f5d0 msgr2=0x7f48d80d0370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:00.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.719+0000 7f48dce79640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d815f5d0 0x7f48d80d0370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.719+0000 7f48dce79640 1 -- 172.21.15.63:0/798225553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d813edc0 con 0x7f48d815ec80 2024-09-17T04:23:00.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.719+0000 7f48dce79640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009d90 tx=0x7f48d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.721+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c015070 con 0x7fa624074000 2024-09-17T04:23:00.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.724+0000 7fa629ef9640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa624072f60 con 0x7fa624074000 2024-09-17T04:23:00.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.724+0000 7fa629ef9640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa624073520 con 0x7fa624074000 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.723+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0044070 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.723+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48d0004450 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.723+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0004860 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.723+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d813f330 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.723+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d813c050 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.724+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f48d002d410 con 0x7f48d815ec80 2024-09-17T04:23:00.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.724+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f48d00364a0 con 0x7f48d815ec80 2024-09-17T04:23:00.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.725+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa61c00e9b0 con 0x7fa624074000 2024-09-17T04:23:00.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.725+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00ede0 con 0x7fa624074000 2024-09-17T04:23:00.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.726+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa61c018070 con 0x7fa624074000 2024-09-17T04:23:00.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.726+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa61c01a870 con 0x7fa624074000 2024-09-17T04:23:00.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.727+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa604005290 con 0x7fa624074000 2024-09-17T04:23:00.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.731+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b8005290 con 0x7f48d815ec80 2024-09-17T04:23:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.736+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa61c011460 con 0x7fa624074000 2024-09-17T04:23:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.743+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fb9f0005580 con 0x7fba1015ecd0 2024-09-17T04:23:00.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.735+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f48d004d080 con 0x7f48d815ec80 2024-09-17T04:23:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.752+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdf98005580 con 0x7fdfb40b6720 2024-09-17T04:23:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.755+0000 7fb9f77fe640 1 -- 172.21.15.63:0/3052586650 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v9)=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fba0801bb50 con 0x7fba1015ecd0 2024-09-17T04:23:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 msgr2=0x7fba100b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c7a0 tx=0x7fba0800cc60 comp rx=0 tx=0).stop 2024-09-17T04:23:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 shutdown_connections 2024-09-17T04:23:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fba100ca1b0 0x7fba100ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1015ecd0 0x7fba100b0be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 --2- 172.21.15.63:0/3052586650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fba100c9da0 0x7fba10201ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 >> 172.21.15.63:0/3052586650 conn(0x7fba1006d5d0 msgr2=0x7fba100741b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 shutdown_connections 2024-09-17T04:23:00.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.757+0000 7fb9f57fa640 1 -- 172.21.15.63:0/3052586650 wait complete. 2024-09-17T04:23:00.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.760+0000 7fc351720640 1 -- 172.21.15.63:0/945933356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc330005270 msgr2=0x7fc33000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.760+0000 7fc351720640 1 --2- 172.21.15.63:0/945933356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc330005270 0x7fc33000b9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc34400c590 tx=0x7fc330005830 comp rx=0 tx=0).stop 2024-09-17T04:23:00.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.760+0000 7fc34b7fe640 1 -- 172.21.15.63:0/945933356 reap_dead start 2024-09-17T04:23:00.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.761+0000 7fc351720640 1 -- 172.21.15.63:0/945933356 shutdown_connections 2024-09-17T04:23:00.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.761+0000 7fc351720640 1 -- 172.21.15.63:0/945933356 >> 172.21.15.63:0/945933356 conn(0x7fc34c0b1c20 msgr2=0x7fc34c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.764+0000 7fc351720640 1 -- 172.21.15.63:0/945933356 shutdown_connections 2024-09-17T04:23:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.764+0000 7fc351720640 1 -- 172.21.15.63:0/945933356 wait complete. 2024-09-17T04:23:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.767+0000 7fc351720640 1 Processor -- start 2024-09-17T04:23:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.767+0000 7fc351720640 1 -- start start 2024-09-17T04:23:00.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.770+0000 7fc351720640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.770+0000 7fc351720640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc34c14a420 0x7fc34c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.770+0000 7fc351720640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc34c0b4680 0x7fc34c15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc351720640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c15f210 con 0x7fc34c0b4680 2024-09-17T04:23:00.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc351720640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c15f090 con 0x7fc330005270 2024-09-17T04:23:00.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc351720640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc34c15f390 con 0x7fc34c14a420 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7f8294cd0640 1 -- 172.21.15.63:0/2444304695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82900ce080 msgr2=0x7f82900afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7f8294cd0640 1 --2- 172.21.15.63:0/2444304695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82900ce080 0x7f82900afce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8278005fd0 tx=0x7f827802a4f0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7f8294cd0640 1 -- 172.21.15.63:0/2444304695 shutdown_connections 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7f8294cd0640 1 --2- 172.21.15.63:0/2444304695 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82900ce080 0x7f82900afce0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7f8294cd0640 1 --2- 172.21.15.63:0/2444304695 >> v2:172.21.15.112:3300/0 conn(0x7f82900cebb0 0x7f82900b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7f8294cd0640 1 -- 172.21.15.63:0/2444304695 >> 172.21.15.63:0/2444304695 conn(0x7f82900d0fe0 msgr2=0x7f82900cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc34affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc34affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48404/0 (socket says 172.21.15.63:48404) 2024-09-17T04:23:00.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc34affd640 1 -- 172.21.15.63:0/1983739149 learned_addr learned my addr 172.21.15.63:0/1983739149 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.771+0000 7fc34a7fc640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc34c14a420 0x7fc34c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7fc34affd640 1 -- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc34c14a420 msgr2=0x7fc34c14eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7fc34affd640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc34c14a420 0x7fc34c14eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7fc34affd640 1 -- 172.21.15.63:0/1983739149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc34c0b4680 msgr2=0x7fc34c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7fc34affd640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc34c0b4680 0x7fc34c15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.772+0000 7fc34affd640 1 -- 172.21.15.63:0/1983739149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c14e020 con 0x7fc330005270 2024-09-17T04:23:00.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.773+0000 7fed629ad640 1 -- 172.21.15.63:0/2744122252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0d1dc0 msgr2=0x7fed5c0b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.773+0000 7fed5affd640 1 -- 172.21.15.63:0/2744122252 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50031600 con 0x7fed5c0d1dc0 2024-09-17T04:23:00.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.773+0000 7fed629ad640 1 --2- 172.21.15.63:0/2744122252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0d1dc0 0x7fed5c0b6330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed50009820 tx=0x7fed5002a510 comp rx=0 tx=0).stop 2024-09-17T04:23:00.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.775+0000 7fdfa2ffd640 1 -- 172.21.15.63:0/1984251607 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v10)=0 v10) ==== 106+0+0 (secure 0 0 0) 0x7fdfa8004940 con 0x7fdfb40b6720 2024-09-17T04:23:00.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.775+0000 7fc34affd640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c400 tx=0x7fc33c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.777+0000 7fed629ad640 1 -- 172.21.15.63:0/2744122252 shutdown_connections 2024-09-17T04:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.777+0000 7fed629ad640 1 --2- 172.21.15.63:0/2744122252 >> v2:172.21.15.63:3300/0 conn(0x7fed5c0b1300 0x7fed5c0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.777+0000 7fed629ad640 1 --2- 172.21.15.63:0/2744122252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0d1dc0 0x7fed5c0b6330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.777+0000 7fed629ad640 1 -- 172.21.15.63:0/2744122252 >> 172.21.15.63:0/2744122252 conn(0x7fed5c0d12a0 msgr2=0x7fed5c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.776+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011790 con 0x7fc330005270 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.776+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc33c017070 con 0x7fc330005270 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.776+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c011ca0 con 0x7fc330005270 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.776+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34c14e2c0 con 0x7fc330005270 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.776+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34c14b910 con 0x7fc330005270 2024-09-17T04:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.777+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc33c01c460 con 0x7fc330005270 2024-09-17T04:23:00.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc33c0129e0 con 0x7fc330005270 2024-09-17T04:23:00.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc328005290 con 0x7fc330005270 2024-09-17T04:23:00.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fed629ad640 1 -- 172.21.15.63:0/2744122252 shutdown_connections 2024-09-17T04:23:00.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fed629ad640 1 -- 172.21.15.63:0/2744122252 wait complete. 2024-09-17T04:23:00.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7fed629ad640 1 Processor -- start 2024-09-17T04:23:00.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7f8294cd0640 1 -- 172.21.15.63:0/2444304695 shutdown_connections 2024-09-17T04:23:00.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/276903616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8009ba0 msgr2=0x7fc5e80df180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.778+0000 7fc5f7ad5640 1 --2- 172.21.15.63:0/276903616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8009ba0 0x7fc5e80df180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc5f006af90 tx=0x7fc5f00a66f0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.779+0000 7f4682a39640 1 -- 172.21.15.63:0/3177614855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46740e3200 msgr2=0x7f4674053150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.779+0000 7f4682a39640 1 --2- 172.21.15.63:0/3177614855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46740e3200 0x7f4674053150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f467c06ad50 tx=0x7f467c0a6580 comp rx=0 tx=0).stop 2024-09-17T04:23:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7f4682a39640 1 -- 172.21.15.63:0/3177614855 shutdown_connections 2024-09-17T04:23:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7f4682a39640 1 --2- 172.21.15.63:0/3177614855 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f46740e3200 0x7f4674053150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7f4682a39640 1 --2- 172.21.15.63:0/3177614855 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 0x7f4674007550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7f4682a39640 1 -- 172.21.15.63:0/3177614855 >> 172.21.15.63:0/3177614855 conn(0x7f467403a680 msgr2=0x7f467403aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.782+0000 7fed629ad640 1 -- start start 2024-09-17T04:23:00.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.781+0000 7f8294cd0640 1 -- 172.21.15.63:0/2444304695 wait complete. 2024-09-17T04:23:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.784+0000 7f8294cd0640 1 Processor -- start 2024-09-17T04:23:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.784+0000 7f8294cd0640 1 -- start start 2024-09-17T04:23:00.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.784+0000 7f4682a39640 1 -- 172.21.15.63:0/3177614855 shutdown_connections 2024-09-17T04:23:00.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/276903616 shutdown_connections 2024-09-17T04:23:00.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fc5f7ad5640 1 --2- 172.21.15.63:0/276903616 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e8009ba0 0x7fc5e80df180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/276903616 >> 172.21.15.63:0/276903616 conn(0x7fc5e8051420 msgr2=0x7fc5e8051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fed629ad640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fed629ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 0x7fed5c159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 msgr2=0x7fdfb4205740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 0x7fdfb4205740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40c7410 tx=0x7fdfa80035f0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.785+0000 7fed5bfff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:44596/0 (socket says 172.21.15.63:44596) 2024-09-17T04:23:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 shutdown_connections 2024-09-17T04:23:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfb40b6720 0x7fdfb4205740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb415c130 0x7fdfb40b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 --2- 172.21.15.63:0/1984251607 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfb40ca5c0 0x7fdfb415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 >> 172.21.15.63:0/1984251607 conn(0x7fdfb40cd480 msgr2=0x7fdfb40cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fed5bfff640 1 -- 172.21.15.63:0/2310226204 learned_addr learned my addr 172.21.15.63:0/2310226204 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 shutdown_connections 2024-09-17T04:23:00.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fdfb8e41640 1 -- 172.21.15.63:0/1984251607 wait complete. 2024-09-17T04:23:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fed5b7fe640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 0x7fed5c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.786+0000 7fed629ad640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 0x7fed5c0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fed60f4a640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 0x7fed5c0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0ae440 con 0x7fed5c0d1dc0 2024-09-17T04:23:00.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f8294cd0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82900718b0 0x7f829015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc33c011e40 con 0x7fc330005270 2024-09-17T04:23:00.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f8294cd0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c0b2bc0 con 0x7fed5c0b1300 2024-09-17T04:23:00.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fed5c0ae5c0 con 0x7fed5c0ae030 2024-09-17T04:23:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f8294cd0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f828effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.784+0000 7f4682a39640 1 -- 172.21.15.63:0/3177614855 wait complete. 2024-09-17T04:23:00.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f8294cd0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f829015f220 con 0x7f82900cebb0 2024-09-17T04:23:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/276903616 shutdown_connections 2024-09-17T04:23:00.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/276903616 wait complete. 2024-09-17T04:23:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f828ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7f828ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:44608/0 (socket says 172.21.15.63:44608) 2024-09-17T04:23:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7f828ffff640 1 -- 172.21.15.63:0/622777895 learned_addr learned my addr 172.21.15.63:0/622777895 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f828effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39226/0 (socket says 172.21.15.63:39226) 2024-09-17T04:23:00.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5b7fe640 1 -- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 msgr2=0x7fed5c1f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5b7fe640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5b7fe640 1 -- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 msgr2=0x7fed5c0b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5b7fe640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 0x7fed5c0b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5b7fe640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c1f8eb0 con 0x7fed5c0b1300 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed60f4a640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 0x7fed5c0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:00.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7fed5bfff640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:00.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f829015f0a0 con 0x7f82900718b0 2024-09-17T04:23:00.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.788+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f829015f3a0 con 0x7f82901593e0 2024-09-17T04:23:00.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 -- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82900718b0 msgr2=0x7f829015b8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82900718b0 0x7f829015b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 -- 172.21.15.63:0/622777895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 msgr2=0x7f829015be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8290157df0 con 0x7f82901593e0 2024-09-17T04:23:00.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7fed5b7fe640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 0x7fed5c159710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed5400edd0 tx=0x7fed5400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828ffff640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f82780099f0 tx=0x7f8278004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.789+0000 7f828effd640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:00.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.787+0000 7f4682a39640 1 Processor -- start 2024-09-17T04:23:00.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5400ce50 con 0x7fed5c0b1300 2024-09-17T04:23:00.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c09d3a0 con 0x7fed5c0b1300 2024-09-17T04:23:00.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c09d960 con 0x7fed5c0b1300 2024-09-17T04:23:00.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed54004c10 con 0x7fed5c0b1300 2024-09-17T04:23:00.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54003970 con 0x7fed5c0b1300 2024-09-17T04:23:00.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fc5f7ad5640 1 Processor -- start 2024-09-17T04:23:00.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7f4682a39640 1 -- start start 2024-09-17T04:23:00.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.791+0000 7fc5f7ad5640 1 -- start start 2024-09-17T04:23:00.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.793+0000 7f4682a39640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.793+0000 7f4682a39640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 0x7f467404cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.793+0000 7f4681a37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.793+0000 7f4681a37640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48420/0 (socket says 172.21.15.63:48420) 2024-09-17T04:23:00.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e8005c60 0x7fc5e80209f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4681a37640 1 -- 172.21.15.63:0/2650668350 learned_addr learned my addr 172.21.15.63:0/2650668350 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4681236640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 0x7f467404cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4682a39640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46740e3200 0x7f467404d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5e8009ba0 0x7fc5e8178650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:00.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46740e7510 con 0x7f46740e3200 2024-09-17T04:23:00.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4674053e70 con 0x7f4674053690 2024-09-17T04:23:00.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f46740e7690 con 0x7f4674054190 2024-09-17T04:23:00.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8006d70 con 0x7fc5e8005c60 2024-09-17T04:23:00.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f6072640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:00.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f6072640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:48434/0 (socket says 172.21.15.63:48434) 2024-09-17T04:23:00.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f6072640 1 -- 172.21.15.63:0/2639352829 learned_addr learned my addr 172.21.15.63:0/2639352829 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:00.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e800be40 con 0x7fc5e802ab70 2024-09-17T04:23:00.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.794+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e8006ef0 con 0x7fc5e8009ba0 2024-09-17T04:23:00.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fc5f6072640 1 -- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5e8009ba0 msgr2=0x7fc5e8178650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T04:23:00.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fc5f6072640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5e8009ba0 0x7fc5e8178650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fc5f6072640 1 -- 172.21.15.63:0/2639352829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e8005c60 msgr2=0x7fc5e80209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fc5f6072640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e8005c60 0x7fc5e80209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed5401d020 con 0x7fed5c0b1300 2024-09-17T04:23:00.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fed540058e0 con 0x7fed5c0b1300 2024-09-17T04:23:00.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.795+0000 7fc5f6072640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e80dc370 con 0x7fc5e802ab70 2024-09-17T04:23:00.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed38005290 con 0x7fed5c0b1300 2024-09-17T04:23:00.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278041070 con 0x7f82901593e0 2024-09-17T04:23:00.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8278005310 con 0x7f82901593e0 2024-09-17T04:23:00.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780047a0 con 0x7f82901593e0 2024-09-17T04:23:00.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82901580d0 con 0x7f82901593e0 2024-09-17T04:23:00.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.799+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8290158690 con 0x7f82901593e0 2024-09-17T04:23:00.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.801+0000 7fc5f6072640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c390 tx=0x7fc5e000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.802+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fed54024070 con 0x7fed5c0b1300 2024-09-17T04:23:00.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.802+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8274005290 con 0x7f82901593e0 2024-09-17T04:23:00.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.802+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0017070 con 0x7fc5e802ab70 2024-09-17T04:23:00.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.802+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5e00053c0 con 0x7fc5e802ab70 2024-09-17T04:23:00.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.802+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e80dc650 con 0x7fc5e802ab70 2024-09-17T04:23:00.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7fc5f7ad5640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e8021240 con 0x7fc5e802ab70 2024-09-17T04:23:00.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f827802ad10 con 0x7f82901593e0 2024-09-17T04:23:00.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8278031830 con 0x7f82901593e0 2024-09-17T04:23:00.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.804+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003830 con 0x7fc5e802ab70 2024-09-17T04:23:00.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.804+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc5e001a070 con 0x7fc5e802ab70 2024-09-17T04:23:00.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 -- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 msgr2=0x7f467404cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 0x7f467404cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 -- 172.21.15.63:0/2650668350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46740e3200 msgr2=0x7f467404d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46740e3200 0x7f467404d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46740d4390 con 0x7f4674053690 2024-09-17T04:23:00.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.803+0000 7f4681a37640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f467800d740 tx=0x7f467800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:00.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.807+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678017070 con 0x7f4674053690 2024-09-17T04:23:00.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.830 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.807+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8278031b90 con 0x7f82901593e0 2024-09-17T04:23:00.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.807+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46740d4670 con 0x7f4674053690 2024-09-17T04:23:00.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.807+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46740d4c30 con 0x7f4674053690 2024-09-17T04:23:00.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.808+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4678009d20 con 0x7f4674053690 2024-09-17T04:23:00.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.808+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46780106c0 con 0x7f4674053690 2024-09-17T04:23:00.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.805+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e80074a0 con 0x7fc5e802ab70 2024-09-17T04:23:00.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.809+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc5e001c780 con 0x7fc5e802ab70 2024-09-17T04:23:00.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.809+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46740e7bb0 con 0x7f4674053690 2024-09-17T04:23:00.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.809+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f467801a070 con 0x7f4674053690 2024-09-17T04:23:00.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.809+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f467801cba0 con 0x7f4674053690 2024-09-17T04:23:00.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.812+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4678010860 con 0x7f4674053690 2024-09-17T04:23:00.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.812+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc5e0021020 con 0x7fc5e802ab70 2024-09-17T04:23:00.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.844+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f9050005580 con 0x7f90700b3640 2024-09-17T04:23:00.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.857+0000 7f906cff9640 1 -- 172.21.15.63:0/1423200521 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f9068012b00 con 0x7f90700b3640 2024-09-17T04:23:00.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.864+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 msgr2=0x7f9070202800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.864+0000 7f90567fc640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f906800cc10 tx=0x7f906800a430 comp rx=0 tx=0).stop 2024-09-17T04:23:00.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.870+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 shutdown_connections 2024-09-17T04:23:00.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.870+0000 7f90567fc640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9070162d00 0x7f9070204bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.870+0000 7f90567fc640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9070202eb0 0x7f907015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.870+0000 7f90567fc640 1 --2- 172.21.15.63:0/1423200521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f90700b3640 0x7f9070202800 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.870+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 >> 172.21.15.63:0/1423200521 conn(0x7f9070070b20 msgr2=0x7f9070160e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.872+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 shutdown_connections 2024-09-17T04:23:00.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.872+0000 7f90567fc640 1 -- 172.21.15.63:0/1423200521 wait complete. 2024-09-17T04:23:00.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.888+0000 7f1ab5ffb640 1 -- 172.21.15.63:0/1471880944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f1ac40dd4d0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.896+0000 7f1ab7fff640 1 -- 172.21.15.63:0/1471880944 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v12)=0 v12) ==== 119+0+0 (secure 0 0 0) 0x7f1ac0021dd0 con 0x7f1ac4008fa0 2024-09-17T04:23:00.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.902+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 msgr2=0x7f1ac40e34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.902+0000 7f1ad0964640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ac001f7a0 tx=0x7f1ac001fc60 comp rx=0 tx=0).stop 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 shutdown_connections 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1ac403ae90 0x7f1ac40d42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1ac4055d10 0x7f1ac4179c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 --2- 172.21.15.63:0/1471880944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ac4008fa0 0x7f1ac40e34c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 >> 172.21.15.63:0/1471880944 conn(0x7f1ac401eae0 msgr2=0x7f1ac4054cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 shutdown_connections 2024-09-17T04:23:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.906+0000 7f1ad0964640 1 -- 172.21.15.63:0/1471880944 wait complete. 2024-09-17T04:23:00.908 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.904+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fade00cca40 con 0x7fade0074640 2024-09-17T04:23:00.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.913+0000 7fadd67fc640 1 -- 172.21.15.63:0/3718882912 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7faddc023030 con 0x7fade0074640 2024-09-17T04:23:00.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 msgr2=0x7fade00c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faddc00b780 tx=0x7faddc00bc40 comp rx=0 tx=0).stop 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 shutdown_connections 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fade00cc630 0x7fade00b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fade00b2850 0x7fade016d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 --2- 172.21.15.63:0/3718882912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade0074640 0x7fade00c6740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 >> 172.21.15.63:0/3718882912 conn(0x7fade006d5d0 msgr2=0x7fade01673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.920+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ff274153ba0 con 0x7ff27415b1d0 2024-09-17T04:23:00.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.921+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 shutdown_connections 2024-09-17T04:23:00.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.921+0000 7fadcbfff640 1 -- 172.21.15.63:0/3718882912 wait complete. 2024-09-17T04:23:00.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.931+0000 7ff2717fa640 1 -- 172.21.15.63:0/3522114388 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7ff26c007cf0 con 0x7ff27415b1d0 2024-09-17T04:23:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.948+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 msgr2=0x7ff2741f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.948+0000 7ff25effd640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009f30 tx=0x7ff26c003f60 comp rx=0 tx=0).stop 2024-09-17T04:23:00.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.939+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f5d2c005850 con 0x7f5d4408b800 2024-09-17T04:23:00.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 shutdown_connections 2024-09-17T04:23:00.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff274151e80 0x7ff2740b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff27415b1d0 0x7ff2741f49e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 --2- 172.21.15.63:0/3522114388 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff27406ddf0 0x7ff2740ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7f5d3affd640 1 -- 172.21.15.63:0/1117139506 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v15)=0 v15) ==== 111+0+0 (secure 0 0 0) 0x7f5d40003cb0 con 0x7f5d4408b800 2024-09-17T04:23:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 >> 172.21.15.63:0/3522114388 conn(0x7ff274073400 msgr2=0x7ff2740c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 shutdown_connections 2024-09-17T04:23:00.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.950+0000 7ff25effd640 1 -- 172.21.15.63:0/3522114388 wait complete. 2024-09-17T04:23:00.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.960+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5ee8005580 con 0x7f5f000cac60 2024-09-17T04:23:00.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 msgr2=0x7f5d440c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 0x7f5d440c4e90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000c460 tx=0x7f5d4000c920 comp rx=0 tx=0).stop 2024-09-17T04:23:00.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 shutdown_connections 2024-09-17T04:23:00.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5d4420dd60 0x7f5d4420e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d4408b800 0x7f5d440c4e90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 --2- 172.21.15.63:0/1117139506 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5d44074640 0x7f5d440c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 >> 172.21.15.63:0/1117139506 conn(0x7f5d4406d5d0 msgr2=0x7f5d44169940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 shutdown_connections 2024-09-17T04:23:00.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.963+0000 7f5d38ff9640 1 -- 172.21.15.63:0/1117139506 wait complete. 2024-09-17T04:23:00.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.967+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fc328005580 con 0x7fc330005270 2024-09-17T04:23:00.972 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.972 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-17T04:23:00.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.980+0000 7f5ef67fc640 1 -- 172.21.15.63:0/246967297 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f5ef801c9d0 con 0x7f5f000cac60 2024-09-17T04:23:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.981+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 msgr2=0x7f5f0015cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.981+0000 7f5f07b50640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800cb30 tx=0x7f5ef800a060 comp rx=0 tx=0).stop 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 shutdown_connections 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5f0015d4c0 0x7f5f0015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f000cac60 0x7f5f0015cf80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 --2- 172.21.15.63:0/246967297 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5f00074640 0x7f5f000b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 >> 172.21.15.63:0/246967297 conn(0x7f5f0006d5d0 msgr2=0x7f5f000cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 shutdown_connections 2024-09-17T04:23:00.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.982+0000 7f5f07b50640 1 -- 172.21.15.63:0/246967297 wait complete. 2024-09-17T04:23:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.988+0000 7fc3437fe640 1 -- 172.21.15.63:0/1983739149 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7fc33c012be0 con 0x7fc330005270 2024-09-17T04:23:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.989+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 msgr2=0x7fc34c14b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:00.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.989+0000 7fc351720640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c400 tx=0x7fc33c00c8c0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 shutdown_connections 2024-09-17T04:23:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc34c0b4680 0x7fc34c15dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc34c14a420 0x7fc34c14eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 --2- 172.21.15.63:0/1983739149 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc330005270 0x7fc34c14b0c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:00.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 >> 172.21.15.63:0/1983739149 conn(0x7fc34c0b1c20 msgr2=0x7fc34c14c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:00.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 shutdown_connections 2024-09-17T04:23:00.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.992+0000 7fc351720640 1 -- 172.21.15.63:0/1983739149 wait complete. 2024-09-17T04:23:00.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:00.994+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa604005580 con 0x7fa624074000 2024-09-17T04:23:01.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.012+0000 7fa60bfff640 1 -- 172.21.15.63:0/3646877617 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fa61c01aba0 con 0x7fa624074000 2024-09-17T04:23:01.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.012+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f48b8005580 con 0x7f48d815ec80 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.013+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 msgr2=0x7fa62412f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.013+0000 7fa609ffb640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0018c0 tx=0x7fa61c001d80 comp rx=0 tx=0).stop 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 shutdown_connections 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa62412fbe0 0x7fa62415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa624074000 0x7fa62412f6a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 --2- 172.21.15.63:0/3646877617 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa624142810 0x7fa624158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 >> 172.21.15.63:0/3646877617 conn(0x7fa62406d5d0 msgr2=0x7fa624143530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 shutdown_connections 2024-09-17T04:23:01.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.014+0000 7fa609ffb640 1 -- 172.21.15.63:0/3646877617 wait complete. 2024-09-17T04:23:01.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.016+0000 7f48cdffb640 1 -- 172.21.15.63:0/798225553 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v19)=0 v19) ==== 119+0+0 (secure 0 0 0) 0x7f48d003c070 con 0x7f48d815ec80 2024-09-17T04:23:01.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 msgr2=0x7f48d80cfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f48d0009d90 tx=0x7f48d0003f10 comp rx=0 tx=0).stop 2024-09-17T04:23:01.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 shutdown_connections 2024-09-17T04:23:01.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f48d815f5d0 0x7f48d80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f48d815ec80 0x7f48d80cfe30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 --2- 172.21.15.63:0/798225553 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f48d806f390 0x7f48d813bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.017+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 >> 172.21.15.63:0/798225553 conn(0x7f48d80b1c20 msgr2=0x7f48d81615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.018+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 shutdown_connections 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.018+0000 7f48df8de640 1 -- 172.21.15.63:0/798225553 wait complete. 2024-09-17T04:23:01.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.019+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4674053420 con 0x7f4674053690 2024-09-17T04:23:01.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.024+0000 7f46727fc640 1 -- 172.21.15.63:0/2650668350 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f4678010a40 con 0x7f4674053690 2024-09-17T04:23:01.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.025+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 msgr2=0x7f467404f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.025+0000 7f4682a39640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f467800d740 tx=0x7f467800dc00 comp rx=0 tx=0).stop 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 shutdown_connections 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46740e3200 0x7f467404d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4674054190 0x7f467404cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 --2- 172.21.15.63:0/2650668350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4674053690 0x7f467404f370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 >> 172.21.15.63:0/2650668350 conn(0x7f467403a680 msgr2=0x7f467404fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 shutdown_connections 2024-09-17T04:23:01.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.026+0000 7f4682a39640 1 -- 172.21.15.63:0/2650668350 wait complete. 2024-09-17T04:23:01.029 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.029 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.029 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.034 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.036+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fc5e8032c00 con 0x7fc5e802ab70 2024-09-17T04:23:01.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.040+0000 7fc5e67fc640 1 -- 172.21.15.63:0/2639352829 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fc5e0011e40 con 0x7fc5e802ab70 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 msgr2=0x7fc5e8021760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c390 tx=0x7fc5e000c850 comp rx=0 tx=0).stop 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 shutdown_connections 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc5e802ab70 0x7fc5e8021760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc5e8009ba0 0x7fc5e8178650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 --2- 172.21.15.63:0/2639352829 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc5e8005c60 0x7fc5e80209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 >> 172.21.15.63:0/2639352829 conn(0x7fc5e8051420 msgr2=0x7fc5e80d96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 shutdown_connections 2024-09-17T04:23:01.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fc5dbfff640 1 -- 172.21.15.63:0/2639352829 wait complete. 2024-09-17T04:23:01.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.041+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fed38005580 con 0x7fed5c0b1300 2024-09-17T04:23:01.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.046+0000 7fed58ff9640 1 -- 172.21.15.63:0/2310226204 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7fed5400bbb0 con 0x7fed5c0b1300 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 msgr2=0x7fed5c159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 0x7fed5c159710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed5400edd0 tx=0x7fed5400c740 comp rx=0 tx=0).stop 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 shutdown_connections 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fed5c0b1300 0x7fed5c159710 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed5c0d1dc0 0x7fed5c0b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 --2- 172.21.15.63:0/2310226204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fed5c0ae030 0x7fed5c1f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 >> 172.21.15.63:0/2310226204 conn(0x7fed5c0d12a0 msgr2=0x7fed5c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 shutdown_connections 2024-09-17T04:23:01.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.048+0000 7fed629ad640 1 -- 172.21.15.63:0/2310226204 wait complete. 2024-09-17T04:23:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.054+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f8274005580 con 0x7f82901593e0 2024-09-17T04:23:01.062 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.064+0000 7f8287fff640 1 -- 172.21.15.63:0/622777895 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f8278031d70 con 0x7f82901593e0 2024-09-17T04:23:01.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 msgr2=0x7f829015d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f82780099f0 tx=0x7f8278004260 comp rx=0 tx=0).stop 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 shutdown_connections 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82901593e0 0x7f829015d6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82900cebb0 0x7f829015be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 --2- 172.21.15.63:0/622777895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82900718b0 0x7f829015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 >> 172.21.15.63:0/622777895 conn(0x7f82900d0fe0 msgr2=0x7f8290161450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 shutdown_connections 2024-09-17T04:23:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.065+0000 7f8294cd0640 1 -- 172.21.15.63:0/622777895 wait complete. 2024-09-17T04:23:01.077 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.077 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-17T04:23:01.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config dump 2024-09-17T04:23:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/4010967218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 msgr2=0x7fcfbc0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/4010967218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc0b26c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009830 tx=0x7fcfb002a4a0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/4010967218 shutdown_connections 2024-09-17T04:23:01.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/4010967218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc0b26c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/4010967218 >> 172.21.15.63:0/4010967218 conn(0x7fcfbc06ea80 msgr2=0x7fcfbc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/4010967218 shutdown_connections 2024-09-17T04:23:01.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.231+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/4010967218 wait complete. 2024-09-17T04:23:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.233+0000 7fcfc1c4d640 1 Processor -- start 2024-09-17T04:23:01.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.233+0000 7fcfc1c4d640 1 -- start start 2024-09-17T04:23:01.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.234+0000 7fcfc1c4d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfbc0ae1b0 0x7fcfbc142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.234+0000 7fcfc1c4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.234+0000 7fcfc1c4d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcfbc156620 0x7fcfbc15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfc1c4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0b0c60 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfc1c4d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0b22f0 con 0x7fcfbc0ae1b0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfc1c4d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc0b0de0 con 0x7fcfbc156620 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39276/0 (socket says 172.21.15.63:39276) 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 -- 172.21.15.63:0/3777311064 learned_addr learned my addr 172.21.15.63:0/3777311064 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbb7fe640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfbc0ae1b0 0x7fcfbc142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbbfff640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcfbc156620 0x7fcfbc15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 -- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcfbc156620 msgr2=0x7fcfbc15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcfbc156620 0x7fcfbc15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 -- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfbc0ae1b0 msgr2=0x7fcfbc142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfbc0ae1b0 0x7fcfbc142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 -- 172.21.15.63:0/3777311064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc1e7d80 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfbaffd640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c3c0 tx=0x7fcfac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:01.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac017070 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfac0035f0 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac003a40 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc1e73c0 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.235+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc1432c0 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.236+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfac01a070 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.236+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcfac012740 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.236+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0b26c0 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.238+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcfac021020 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.300+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcfbc15b010 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.301+0000 7fcfa3fff640 1 -- 172.21.15.63:0/3777311064 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fcfac003be0 con 0x7fcfbc15c7f0 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced client_mount_timeout 30 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_client 20/20 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_mgr 20/20 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_ms 1/1 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds 20/20 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_ms 2/2 2024-09-17T04:23:01.302 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_frag true 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_scatterstat true 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_verify_scatter true 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced client_mount_timeout 600 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_client 20/20 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_ms 1/1 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T04:23:01.303 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T04:23:01.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 msgr2=0x7fcfbc15f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c3c0 tx=0x7fcfac00c880 comp rx=0 tx=0).stop 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 shutdown_connections 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fcfbc156620 0x7fcfbc15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfbc15c7f0 0x7fcfbc15f380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 --2- 172.21.15.63:0/3777311064 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fcfbc0ae1b0 0x7fcfbc142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 >> 172.21.15.63:0/3777311064 conn(0x7fcfbc06ea80 msgr2=0x7fcfbc159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 shutdown_connections 2024-09-17T04:23:01.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.302+0000 7fcfc1c4d640 1 -- 172.21.15.63:0/3777311064 wait complete. 2024-09-17T04:23:01.313 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T04:23:01.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T04:23:01.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 -- 172.21.15.63:0/2356534535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40b51c0 msgr2=0x7f03f415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 --2- 172.21.15.63:0/2356534535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40b51c0 0x7f03f415c6e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03e4005fd0 tx=0x7f03e402a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 -- 172.21.15.63:0/2356534535 shutdown_connections 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 --2- 172.21.15.63:0/2356534535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40d1490 0x7f03f40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 --2- 172.21.15.63:0/2356534535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40b51c0 0x7f03f415c6e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 -- 172.21.15.63:0/2356534535 >> 172.21.15.63:0/2356534535 conn(0x7f03f4072ae0 msgr2=0x7f03f4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 -- 172.21.15.63:0/2356534535 shutdown_connections 2024-09-17T04:23:01.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.428+0000 7f03f99c3640 1 -- 172.21.15.63:0/2356534535 wait complete. 2024-09-17T04:23:01.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.430+0000 7f03f99c3640 1 Processor -- start 2024-09-17T04:23:01.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.430+0000 7f03f99c3640 1 -- start start 2024-09-17T04:23:01.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 0x7f03f41477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f40ccbd0 0x7f03f4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f03f40cf2b0 con 0x7f03f40d1490 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f03f40cf130 con 0x7f03f40ccbd0 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f99c3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f03f40cf430 con 0x7f03f40b51c0 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39286/0 (socket says 172.21.15.63:39286) 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f2ffd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 0x7f03f41477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 -- 172.21.15.63:0/186427860 learned_addr learned my addr 172.21.15.63:0/186427860 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f27fc640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f40ccbd0 0x7f03f4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 -- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 msgr2=0x7f03f41477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 0x7f03f41477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 -- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f40ccbd0 msgr2=0x7f03f4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f40ccbd0 0x7f03f4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 -- 172.21.15.63:0/186427860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f41f6e50 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f2ffd640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 0x7f03f41477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.432+0000 7f03f37fe640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00ea70 tx=0x7f03ec00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00ce40 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03ec004c10 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f41f70f0 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec005020 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f41f76b0 con 0x7f03f40d1490 2024-09-17T04:23:01.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03ec005550 con 0x7f03f40d1490 2024-09-17T04:23:01.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.433+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03ec010770 con 0x7f03f40d1490 2024-09-17T04:23:01.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.434+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f40cf8f0 con 0x7f03f40d1490 2024-09-17T04:23:01.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.436+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03ec026020 con 0x7f03f40d1490 2024-09-17T04:23:01.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.502+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f03f40d2230 con 0x7f03f40d1490 2024-09-17T04:23:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.504+0000 7f03dbfff640 1 -- 172.21.15.63:0/186427860 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f03ec010970 con 0x7f03f40d1490 2024-09-17T04:23:01.505 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 msgr2=0x7f03f415a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00ea70 tx=0x7f03ec00ef30 comp rx=0 tx=0).stop 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 shutdown_connections 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f03f40ccbd0 0x7f03f4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f40d1490 0x7f03f415a030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 --2- 172.21.15.63:0/186427860 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f03f40b51c0 0x7f03f41477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 >> 172.21.15.63:0/186427860 conn(0x7f03f4072ae0 msgr2=0x7f03f415f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 shutdown_connections 2024-09-17T04:23:01.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:01.505+0000 7f03f99c3640 1 -- 172.21.15.63:0/186427860 wait complete. 2024-09-17T04:23:01.517 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T04:23:01.517 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T04:23:01.517 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:01.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T04:23:01.542 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:01.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T04:23:01.608 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:01.608 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T04:23:01.674 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:01.674 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T04:23:01.740 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:01.740 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T04:23:01.765 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:01.765 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T04:23:01.830 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:01.831 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T04:23:01.895 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:01.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T04:23:01.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new ca8b7aa0-e7f2-4606-878d-c0fdd56251ed 0 2024-09-17T04:23:02.113 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1018064191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0409aa30 msgr2=0x7f1e0415c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1018064191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0409aa30 0x7f1e0415c860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009830 tx=0x7f1e0002a480 comp rx=0 tx=0).stop 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1018064191 shutdown_connections 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1018064191 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e040cc4c0 0x7f1e040cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1018064191 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e0409aa30 0x7f1e0415c860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1018064191 >> 172.21.15.112:0/1018064191 conn(0x7f1e04074170 msgr2=0x7f1e040b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1018064191 shutdown_connections 2024-09-17T04:23:02.114 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.113+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1018064191 wait complete. 2024-09-17T04:23:02.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.115+0000 7f1e0bf32640 1 Processor -- start 2024-09-17T04:23:02.115 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.115+0000 7f1e0bf32640 1 -- start start 2024-09-17T04:23:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 0x7f1e04156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e0409aa30 0x7f1e04156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.118 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040ccf90 con 0x7f1e0406cde0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040cce10 con 0x7f1e040cc4c0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.116+0000 7f1e0bf32640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1e040cd110 con 0x7f1e0409aa30 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e094cd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e0409aa30 0x7f1e04156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53506/0 (socket says 172.21.15.112:53506) 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 -- 172.21.15.112:0/1694289188 learned_addr learned my addr 172.21.15.112:0/1694289188 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e09cce640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 0x7f1e04156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 -- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e0409aa30 msgr2=0x7f1e04156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e0409aa30 0x7f1e04156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 -- 172.21.15.112:0/1694289188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 msgr2=0x7f1e04156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 0x7f1e04156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 -- 172.21.15.112:0/1694289188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e041546d0 con 0x7f1e040cc4c0 2024-09-17T04:23:02.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e09cce640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 0x7f1e04156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0a4cf640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009fd0 tx=0x7f1dfc00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc003970 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dfc003c20 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e041549b0 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc004280 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e04154f70 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1dfc004b40 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.117+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1dfc00b920 con 0x7f1e040cc4c0 2024-09-17T04:23:02.120 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.118+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e040cd600 con 0x7f1e040cc4c0 2024-09-17T04:23:02.121 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.121+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1dfc024070 con 0x7f1e040cc4c0 2024-09-17T04:23:02.193 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.191+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca8b7aa0-e7f2-4606-878d-c0fdd56251ed", "id": 0} v 0) -- 0x7f1e040cca50 con 0x7f1e040cc4c0 2024-09-17T04:23:02.194 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.194+0000 7f1dfa7fc640 1 -- 172.21.15.112:0/1694289188 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca8b7aa0-e7f2-4606-878d-c0fdd56251ed", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1dfc009880 con 0x7f1e040cc4c0 2024-09-17T04:23:02.195 INFO:teuthology.orchestra.run.smithi112.stdout:0 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 msgr2=0x7f1e04150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009fd0 tx=0x7f1dfc00c740 comp rx=0 tx=0).stop 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 shutdown_connections 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e040cc4c0 0x7f1e04150a50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e0409aa30 0x7f1e04156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 --2- 172.21.15.112:0/1694289188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e0406cde0 0x7f1e04156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.195+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 >> 172.21.15.112:0/1694289188 conn(0x7f1e04074170 msgr2=0x7f1e040cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.196+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 shutdown_connections 2024-09-17T04:23:02.196 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.196+0000 7f1e0bf32640 1 -- 172.21.15.112:0/1694289188 wait complete. 2024-09-17T04:23:02.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 3092af67-cdec-4fb5-ab0a-4df47973e964 1 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 -- 172.21.15.112:0/3305069187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 msgr2=0x7fd8600b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 --2- 172.21.15.112:0/3305069187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd8600b4ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd86006e630 tx=0x7fd85c02a560 comp rx=0 tx=0).stop 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 -- 172.21.15.112:0/3305069187 shutdown_connections 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 --2- 172.21.15.112:0/3305069187 >> v2:172.21.15.63:3300/0 conn(0x7fd8600b5220 0x7fd86015f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 --2- 172.21.15.112:0/3305069187 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd8600b4ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 --2- 172.21.15.112:0/3305069187 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8601527b0 0x7fd8600cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.319 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 -- 172.21.15.112:0/3305069187 >> 172.21.15.112:0/3305069187 conn(0x7fd860073fa0 msgr2=0x7fd8600743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 -- 172.21.15.112:0/3305069187 shutdown_connections 2024-09-17T04:23:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.319+0000 7fd868550640 1 -- 172.21.15.112:0/3305069187 wait complete. 2024-09-17T04:23:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.320+0000 7fd868550640 1 Processor -- start 2024-09-17T04:23:02.320 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.321+0000 7fd868550640 1 -- start start 2024-09-17T04:23:02.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8600b5220 0x7fd86014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.324 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8601527b0 0x7fd86015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd86015fa70 con 0x7fd8601527b0 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd86015f8f0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd868550640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd86015fbf0 con 0x7fd8600b5220 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd8662ec640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8600b5220 0x7fd86014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53534/0 (socket says 172.21.15.112:53534) 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 -- 172.21.15.112:0/1879411015 learned_addr learned my addr 172.21.15.112:0/1879411015 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd866aed640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8601527b0 0x7fd86015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 -- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8600b5220 msgr2=0x7fd86014ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8600b5220 0x7fd86014ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 -- 172.21.15.112:0/1879411015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8601527b0 msgr2=0x7fd86015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8601527b0 0x7fd86015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.325 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 -- 172.21.15.112:0/1879411015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8601571f0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd865aeb640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd85c000c00 tx=0x7fd85c0038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.322+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c03e030 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd85c003ca0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85c035040 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8601574d0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd860157a90 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd85c041030 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd85c043ad0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.323+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd860156f60 con 0x7fd8600ce3d0 2024-09-17T04:23:02.326 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.326+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd85c043d20 con 0x7fd8600ce3d0 2024-09-17T04:23:02.397 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.395+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3092af67-cdec-4fb5-ab0a-4df47973e964", "id": 1} v 0) -- 0x7fd86015f1a0 con 0x7fd8600ce3d0 2024-09-17T04:23:02.399 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.399+0000 7fd856ffd640 1 -- 172.21.15.112:0/1879411015 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3092af67-cdec-4fb5-ab0a-4df47973e964", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd85c004f30 con 0x7fd8600ce3d0 2024-09-17T04:23:02.399 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-17T04:23:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 msgr2=0x7fd86015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.400 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd85c000c00 tx=0x7fd85c0038a0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 shutdown_connections 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8600ce3d0 0x7fd86015df60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8601527b0 0x7fd86015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 --2- 172.21.15.112:0/1879411015 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8600b5220 0x7fd86014ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 >> 172.21.15.112:0/1879411015 conn(0x7fd860073fa0 msgr2=0x7fd8600b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 shutdown_connections 2024-09-17T04:23:02.401 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.400+0000 7fd868550640 1 -- 172.21.15.112:0/1879411015 wait complete. 2024-09-17T04:23:02.411 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 30ad4e4b-a414-4cc1-8cb1-d7413b10bee1 2 2024-09-17T04:23:02.525 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 -- 172.21.15.112:0/865538742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957009aa30 msgr2=0x7f95700ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 --2- 172.21.15.112:0/865538742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957009aa30 0x7f95700ae1b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9568009ca0 tx=0x7f956802ab10 comp rx=0 tx=0).stop 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 -- 172.21.15.112:0/865538742 shutdown_connections 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 --2- 172.21.15.112:0/865538742 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957009aa30 0x7f95700ae1b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 -- 172.21.15.112:0/865538742 >> 172.21.15.112:0/865538742 conn(0x7f9570074170 msgr2=0x7f95700b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 -- 172.21.15.112:0/865538742 shutdown_connections 2024-09-17T04:23:02.526 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.525+0000 7f9576a94640 1 -- 172.21.15.112:0/865538742 wait complete. 2024-09-17T04:23:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.527+0000 7f9576a94640 1 Processor -- start 2024-09-17T04:23:02.527 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.527+0000 7f9576a94640 1 -- start start 2024-09-17T04:23:02.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570157c20 0x7f95700af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f95700cd360 con 0x7f9570157c20 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f95700cd1e0 con 0x7f957009aa30 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9576a94640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f95700cd4e0 con 0x7f957015b900 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f956ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.528+0000 7f9574830640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:53634/0 (socket says 172.21.15.112:53634) 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53546/0 (socket says 172.21.15.112:53546) 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956ffff640 1 -- 172.21.15.112:0/1685147805 learned_addr learned my addr 172.21.15.112:0/1685147805 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9575031640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570157c20 0x7f95700af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.530 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 -- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 msgr2=0x7f95700aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 -- 172.21.15.112:0/1685147805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570157c20 msgr2=0x7f95700af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570157c20 0x7f95700af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 -- 172.21.15.112:0/1685147805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570149b30 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956ffff640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9574830640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f956400c390 tx=0x7f956400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564017070 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95640053c0 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564003850 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95701f77a0 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95701f6cc0 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f956401a070 con 0x7f957009aa30 2024-09-17T04:23:02.531 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.529+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9564011c20 con 0x7f957009aa30 2024-09-17T04:23:02.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.531+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95700ae1b0 con 0x7f957009aa30 2024-09-17T04:23:02.532 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.533+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9564021070 con 0x7f957009aa30 2024-09-17T04:23:02.605 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.603+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30ad4e4b-a414-4cc1-8cb1-d7413b10bee1", "id": 2} v 0) -- 0x7f95700ce500 con 0x7f957009aa30 2024-09-17T04:23:02.606 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.607+0000 7f956d7fa640 1 -- 172.21.15.112:0/1685147805 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30ad4e4b-a414-4cc1-8cb1-d7413b10bee1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f95640115f0 con 0x7f957009aa30 2024-09-17T04:23:02.607 INFO:teuthology.orchestra.run.smithi112.stdout:2 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 msgr2=0x7f957009db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f956400c390 tx=0x7f956400c850 comp rx=0 tx=0).stop 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 shutdown_connections 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9570157c20 0x7f95700af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f957015b900 0x7f95700aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 --2- 172.21.15.112:0/1685147805 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f957009aa30 0x7f957009db30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 >> 172.21.15.112:0/1685147805 conn(0x7f9570074170 msgr2=0x7f95700b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 shutdown_connections 2024-09-17T04:23:02.608 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.608+0000 7f9576a94640 1 -- 172.21.15.112:0/1685147805 wait complete. 2024-09-17T04:23:02.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new b8d95ef1-7f46-4a8f-904b-f34be2c51754 3 2024-09-17T04:23:02.732 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 -- 172.21.15.112:0/1607050929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170155aa0 msgr2=0x7f31700d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 --2- 172.21.15.112:0/1607050929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170155aa0 0x7f31700d0340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31700afed0 tx=0x7f316002a4b0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 -- 172.21.15.112:0/1607050929 shutdown_connections 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 --2- 172.21.15.112:0/1607050929 >> v2:172.21.15.63:3300/0 conn(0x7f317015f5c0 0x7f31700c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 --2- 172.21.15.112:0/1607050929 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170075e40 0x7f317015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 --2- 172.21.15.112:0/1607050929 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170155aa0 0x7f31700d0340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 -- 172.21.15.112:0/1607050929 >> 172.21.15.112:0/1607050929 conn(0x7f31700cd480 msgr2=0x7f31700cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 -- 172.21.15.112:0/1607050929 shutdown_connections 2024-09-17T04:23:02.733 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.732+0000 7f3177389640 1 -- 172.21.15.112:0/1607050929 wait complete. 2024-09-17T04:23:02.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.734+0000 7f3177389640 1 Processor -- start 2024-09-17T04:23:02.734 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.734+0000 7f3177389640 1 -- start start 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 0x7f31701e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f317015f5c0 0x7f317006fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f317006e6d0 con 0x7f317015f5c0 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f317006e550 con 0x7f3170075e40 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3177389640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31700c5de0 con 0x7f3170155aa0 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53554/0 (socket says 172.21.15.112:53554) 2024-09-17T04:23:02.737 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 -- 172.21.15.112:0/2632145783 learned_addr learned my addr 172.21.15.112:0/2632145783 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3174924640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 0x7f31701e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175926640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f317015f5c0 0x7f317006fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 -- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 msgr2=0x7f31701e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 0x7f31701e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 -- 172.21.15.112:0/2632145783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f317015f5c0 msgr2=0x7f317006fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f317015f5c0 0x7f317006fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3175125640 1 -- 172.21.15.112:0/2632145783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31701e6d30 con 0x7f3170075e40 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.735+0000 7f3174924640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 0x7f31701e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3175125640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3160000c00 tx=0x7f3160003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316003e030 con 0x7f3170075e40 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3160003d10 con 0x7f3170075e40 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160035040 con 0x7f3170075e40 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31700b4f80 con 0x7f3170075e40 2024-09-17T04:23:02.738 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31700b5540 con 0x7f3170075e40 2024-09-17T04:23:02.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3160041030 con 0x7f3170075e40 2024-09-17T04:23:02.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.736+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3160043d00 con 0x7f3170075e40 2024-09-17T04:23:02.739 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.737+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31700c6240 con 0x7f3170075e40 2024-09-17T04:23:02.741 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.741+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3160043410 con 0x7f3170075e40 2024-09-17T04:23:02.812 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.812+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b8d95ef1-7f46-4a8f-904b-f34be2c51754", "id": 3} v 0) -- 0x7f317015ef20 con 0x7f3170075e40 2024-09-17T04:23:02.816 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.816+0000 7f3165ffb640 1 -- 172.21.15.112:0/2632145783 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8d95ef1-7f46-4a8f-904b-f34be2c51754", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3160004f80 con 0x7f3170075e40 2024-09-17T04:23:02.816 INFO:teuthology.orchestra.run.smithi112.stdout:3 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 msgr2=0x7f31701f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3160000c00 tx=0x7f3160003820 comp rx=0 tx=0).stop 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 shutdown_connections 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f317015f5c0 0x7f317006fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3170155aa0 0x7f31701e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 --2- 172.21.15.112:0/2632145783 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3170075e40 0x7f31701f1cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.817 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 >> 172.21.15.112:0/2632145783 conn(0x7f31700cd480 msgr2=0x7f31700b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 shutdown_connections 2024-09-17T04:23:02.818 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.817+0000 7f3177389640 1 -- 172.21.15.112:0/2632145783 wait complete. 2024-09-17T04:23:02.827 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 5d4d52cc-a843-4963-b45f-0bd4c63aa345 4 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 -- 172.21.15.112:0/1223336690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 msgr2=0x7f13a015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 --2- 172.21.15.112:0/1223336690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a015d900 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1394009900 tx=0x7f139402a6e0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 -- 172.21.15.112:0/1223336690 shutdown_connections 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 --2- 172.21.15.112:0/1223336690 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a015d900 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 -- 172.21.15.112:0/1223336690 >> 172.21.15.112:0/1223336690 conn(0x7f13a006d5d0 msgr2=0x7f13a0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 -- 172.21.15.112:0/1223336690 shutdown_connections 2024-09-17T04:23:02.940 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.939+0000 7f13a7030640 1 -- 172.21.15.112:0/1223336690 wait complete. 2024-09-17T04:23:02.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.941+0000 7f13a7030640 1 Processor -- start 2024-09-17T04:23:02.941 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.941+0000 7f13a7030640 1 -- start start 2024-09-17T04:23:02.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.944 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a0160550 0x7f13a00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f13a00d0650 con 0x7f13a0160550 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0160c30 con 0x7f13a00cf3f0 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f13a00d07d0 con 0x7f13a00d16f0 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a4dcc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:53668/0 (socket says 172.21.15.112:53668) 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 -- 172.21.15.112:0/1483294421 learned_addr learned my addr 172.21.15.112:0/1483294421 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a4dcc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53560/0 (socket says 172.21.15.112:53560) 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a55cd640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a0160550 0x7f13a00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 -- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 msgr2=0x7f13a0153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 -- 172.21.15.112:0/1483294421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a0160550 msgr2=0x7f13a00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a0160550 0x7f13a00cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 -- 172.21.15.112:0/1483294421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a0154800 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a4dcc640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139ffff640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f138c00c3c0 tx=0x7f138c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c017070 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f138c0053e0 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a0154ae0 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.943+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c003850 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.944+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01550a0 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.944+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f138c01a070 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.944+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f138c011c70 con 0x7f13a00d16f0 2024-09-17T04:23:02.946 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.944+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a015d900 con 0x7f13a00d16f0 2024-09-17T04:23:02.947 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:02.947+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f138c021070 con 0x7f13a00d16f0 2024-09-17T04:23:03.017 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.017+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5d4d52cc-a843-4963-b45f-0bd4c63aa345", "id": 4} v 0) -- 0x7f13a00b5a10 con 0x7f13a00d16f0 2024-09-17T04:23:03.021 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.021+0000 7f139d7fa640 1 -- 172.21.15.112:0/1483294421 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d4d52cc-a843-4963-b45f-0bd4c63aa345", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f138c011590 con 0x7f13a00d16f0 2024-09-17T04:23:03.021 INFO:teuthology.orchestra.run.smithi112.stdout:4 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 msgr2=0x7f13a01558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f138c00c3c0 tx=0x7f138c00c880 comp rx=0 tx=0).stop 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 shutdown_connections 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13a0160550 0x7f13a00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f13a00d16f0 0x7f13a01558a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.022 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 --2- 172.21.15.112:0/1483294421 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f13a00cf3f0 0x7f13a0153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 >> 172.21.15.112:0/1483294421 conn(0x7f13a006d5d0 msgr2=0x7f13a0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 shutdown_connections 2024-09-17T04:23:03.023 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.022+0000 7f13a7030640 1 -- 172.21.15.112:0/1483294421 wait complete. 2024-09-17T04:23:03.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 6c15124d-f37a-43d3-84b4-a3c3e666fdff 5 2024-09-17T04:23:03.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 -- 172.21.15.112:0/4115317397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240ceb40 msgr2=0x7f68240cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.144 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 --2- 172.21.15.112:0/4115317397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240ceb40 0x7f68240cef50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f681c005fd0 tx=0x7f681c02a8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 -- 172.21.15.112:0/4115317397 shutdown_connections 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 --2- 172.21.15.112:0/4115317397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240ceb40 0x7f68240cef50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 -- 172.21.15.112:0/4115317397 >> 172.21.15.112:0/4115317397 conn(0x7f682408bfc0 msgr2=0x7f682409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 -- 172.21.15.112:0/4115317397 shutdown_connections 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.144+0000 7f682987e640 1 -- 172.21.15.112:0/4115317397 wait complete. 2024-09-17T04:23:03.145 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.146+0000 7f682987e640 1 Processor -- start 2024-09-17T04:23:03.146 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.146+0000 7f682987e640 1 -- start start 2024-09-17T04:23:03.148 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 0x7f68241f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240cc1e0 0x7f68240cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f68240d1070 con 0x7f68240cc1e0 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f68240d0ef0 con 0x7f68240b3540 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f682987e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f68240d11f0 con 0x7f68240ceb40 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f6822ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f68227fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 0x7f68241f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f6822ffd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.112:53562/0 (socket says 172.21.15.112:53562) 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.147+0000 7f6822ffd640 1 -- 172.21.15.112:0/871391350 learned_addr learned my addr 172.21.15.112:0/871391350 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68237fe640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240cc1e0 0x7f68240cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.149 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 -- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 msgr2=0x7f68240ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 -- 172.21.15.112:0/871391350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240cc1e0 msgr2=0x7f68240cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240cc1e0 0x7f68240cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 -- 172.21.15.112:0/871391350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68240ccb30 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f6822ffd640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f68227fc640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 0x7f68241f4b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68240ba1b0 tx=0x7f680c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c011790 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f680c017070 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6824160ef0 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c011cc0 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241f5560 con 0x7f68240ceb40 2024-09-17T04:23:03.150 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f680c01c460 con 0x7f68240ceb40 2024-09-17T04:23:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.148+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f680c012d60 con 0x7f68240ceb40 2024-09-17T04:23:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.149+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682406e170 con 0x7f68240ceb40 2024-09-17T04:23:03.151 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.152+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f68240ccb30 con 0x7f68240ceb40 2024-09-17T04:23:03.221 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.221+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c15124d-f37a-43d3-84b4-a3c3e666fdff", "id": 5} v 0) -- 0x7f68240d4020 con 0x7f68240ceb40 2024-09-17T04:23:03.225 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.225+0000 7f681bfff640 1 -- 172.21.15.112:0/871391350 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c15124d-f37a-43d3-84b4-a3c3e666fdff", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f680c0127e0 con 0x7f68240ceb40 2024-09-17T04:23:03.225 INFO:teuthology.orchestra.run.smithi112.stdout:5 2024-09-17T04:23:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 msgr2=0x7f68241f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 0x7f68241f4b90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68240ba1b0 tx=0x7f680c00c760 comp rx=0 tx=0).stop 2024-09-17T04:23:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 shutdown_connections 2024-09-17T04:23:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f68240cc1e0 0x7f68240cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.226 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f68240ceb40 0x7f68241f4b90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 --2- 172.21.15.112:0/871391350 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f68240b3540 0x7f68240ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 >> 172.21.15.112:0/871391350 conn(0x7f682408bfc0 msgr2=0x7f68241619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 shutdown_connections 2024-09-17T04:23:03.227 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.226+0000 7f682987e640 1 -- 172.21.15.112:0/871391350 wait complete. 2024-09-17T04:23:03.237 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new 7a1c0721-b259-464b-b691-8b483f8dc9c1 6 2024-09-17T04:23:03.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 -- 172.21.15.112:0/3828634931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 msgr2=0x7f29800cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 --2- 172.21.15.112:0/3828634931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f29800cee10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2970005fd0 tx=0x7f297002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 -- 172.21.15.112:0/3828634931 shutdown_connections 2024-09-17T04:23:03.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 --2- 172.21.15.112:0/3828634931 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f29800cee10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.348 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 --2- 172.21.15.112:0/3828634931 >> v2:172.21.15.63:3300/0 conn(0x7f298015b900 0x7f29800ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 -- 172.21.15.112:0/3828634931 >> 172.21.15.112:0/3828634931 conn(0x7f2980074170 msgr2=0x7f29800b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 -- 172.21.15.112:0/3828634931 shutdown_connections 2024-09-17T04:23:03.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.348+0000 7f29861c3640 1 -- 172.21.15.112:0/3828634931 wait complete. 2024-09-17T04:23:03.349 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.350+0000 7f29861c3640 1 Processor -- start 2024-09-17T04:23:03.350 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.350+0000 7f29861c3640 1 -- start start 2024-09-17T04:23:03.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.352 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29800cdbf0 0x7f298015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 0x7f29800b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29800cf7a0 con 0x7f29800cdbf0 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f29800cf620 con 0x7f298015b900 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f29861c3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f29800cd1e0 con 0x7f298009aa30 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:53704/0 (socket says 172.21.15.112:53704) 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f297f7fe640 1 -- 172.21.15.112:0/2874616990 learned_addr learned my addr 172.21.15.112:0/2874616990 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f297ffff640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 0x7f29800b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.351+0000 7f297effd640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29800cdbf0 0x7f298015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 -- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 msgr2=0x7f298015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 -- 172.21.15.112:0/2874616990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29800cdbf0 msgr2=0x7f298015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29800cdbf0 0x7f298015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.353 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 -- 172.21.15.112:0/2874616990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29801f5b50 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297f7fe640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f297ffff640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 0x7f29800b0810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f297800c700 tx=0x7f297800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978003b70 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2978003d10 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f29861c3640 1 -- 172.21.15.112:0/2874616990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29801f5e30 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2978005330 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f29861c3640 1 -- 172.21.15.112:0/2874616990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298015c230 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29780054d0 con 0x7f298015b900 2024-09-17T04:23:03.354 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.352+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f2978012a10 con 0x7f298015b900 2024-09-17T04:23:03.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.353+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29800cd700 con 0x7f298015b900 2024-09-17T04:23:03.355 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.355+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2978012420 con 0x7f298015b900 2024-09-17T04:23:03.424 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.424+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a1c0721-b259-464b-b691-8b483f8dc9c1", "id": 6} v 0) -- 0x7f29800b04a0 con 0x7f298015b900 2024-09-17T04:23:03.428 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.428+0000 7f2977fff640 1 -- 172.21.15.112:0/2874616990 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a1c0721-b259-464b-b691-8b483f8dc9c1", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2978012600 con 0x7f298015b900 2024-09-17T04:23:03.429 INFO:teuthology.orchestra.run.smithi112.stdout:6 2024-09-17T04:23:03.429 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 msgr2=0x7f29800b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 0x7f29800b0810 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f297800c700 tx=0x7f297800cbc0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 shutdown_connections 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f298015b900 0x7f29800b0810 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29800cdbf0 0x7f298015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 --2- 172.21.15.112:0/2874616990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f298009aa30 0x7f298015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 >> 172.21.15.112:0/2874616990 conn(0x7f2980074170 msgr2=0x7f29800b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 shutdown_connections 2024-09-17T04:23:03.430 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.429+0000 7f2975ffb640 1 -- 172.21.15.112:0/2874616990 wait complete. 2024-09-17T04:23:03.440 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd new bfd57500-4bb7-456a-a9d1-5b51dd9827a5 7 2024-09-17T04:23:03.552 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 -- 172.21.15.112:0/1361231412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8750003a50 msgr2=0x7f8750003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 --2- 172.21.15.112:0/1361231412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8750003a50 0x7f8750003ec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f875400c260 tx=0x7f8750005830 comp rx=0 tx=0).stop 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 -- 172.21.15.112:0/1361231412 shutdown_connections 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 --2- 172.21.15.112:0/1361231412 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8750003a50 0x7f8750003ec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 -- 172.21.15.112:0/1361231412 >> 172.21.15.112:0/1361231412 conn(0x7f876408bfc0 msgr2=0x7f876409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 -- 172.21.15.112:0/1361231412 shutdown_connections 2024-09-17T04:23:03.553 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.552+0000 7f87695a1640 1 -- 172.21.15.112:0/1361231412 wait complete. 2024-09-17T04:23:03.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.555+0000 7f87695a1640 1 Processor -- start 2024-09-17T04:23:03.555 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.555+0000 7f87695a1640 1 -- start start 2024-09-17T04:23:03.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.557+0000 7f87695a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 0x7f8764153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.557+0000 7f87695a1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.557+0000 7f87695a1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 0x7f87640c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87695a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87640cef50 con 0x7f8750003a50 2024-09-17T04:23:03.559 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87695a1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f876406e3d0 con 0x7f87640cd5a0 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87695a1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87640cf0d0 con 0x7f87641f9940 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87627fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 0x7f87640c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87627fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.112:53726/0 (socket says 172.21.15.112:53726) 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87627fc640 1 -- 172.21.15.112:0/2341201272 learned_addr learned my addr 172.21.15.112:0/2341201272 (peer_addr_for_me v2:172.21.15.112:0/0) 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f8762ffd640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 0x7f8764153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 -- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 msgr2=0x7f87640cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 -- 172.21.15.112:0/2341201272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 msgr2=0x7f8764153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 0x7f8764153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 -- 172.21.15.112:0/2341201272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87640cb740 con 0x7f87640cd5a0 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f8762ffd640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 0x7f8764153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:03.560 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87627fc640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87637fe640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 0x7f87640c8020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87640d0160 tx=0x7f875c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c004d20 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f875c003970 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c003dc0 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.558+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87640cba00 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.559+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87640c89e0 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.559+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f875c020020 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.559+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f875c0045a0 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.559+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876406f670 con 0x7f87640cd5a0 2024-09-17T04:23:03.561 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.561+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f875c027070 con 0x7f87640cd5a0 2024-09-17T04:23:03.633 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.631+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfd57500-4bb7-456a-a9d1-5b51dd9827a5", "id": 7} v 0) -- 0x7f876406ef70 con 0x7f87640cd5a0 2024-09-17T04:23:03.635 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.635+0000 7f875b7fe640 1 -- 172.21.15.112:0/2341201272 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfd57500-4bb7-456a-a9d1-5b51dd9827a5", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f875c004030 con 0x7f87640cd5a0 2024-09-17T04:23:03.635 INFO:teuthology.orchestra.run.smithi112.stdout:7 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 msgr2=0x7f87640c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 0x7f87640c8020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87640d0160 tx=0x7f875c00f790 comp rx=0 tx=0).stop 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 shutdown_connections 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87640cd5a0 0x7f87640c8020 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87641f9940 0x7f87640cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 --2- 172.21.15.112:0/2341201272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8750003a50 0x7f8764153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 >> 172.21.15.112:0/2341201272 conn(0x7f876408bfc0 msgr2=0x7f87640b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.636 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 shutdown_connections 2024-09-17T04:23:03.637 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:03.636+0000 7f87695a1640 1 -- 172.21.15.112:0/2341201272 wait complete. 2024-09-17T04:23:03.646 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T04:23:03.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T04:23:03.649 INFO:tasks.ceph.osd.0:Started 2024-09-17T04:23:03.649 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T04:23:03.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T04:23:03.651 INFO:tasks.ceph.osd.1:Started 2024-09-17T04:23:03.651 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T04:23:03.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T04:23:03.653 INFO:tasks.ceph.osd.2:Started 2024-09-17T04:23:03.653 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T04:23:03.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T04:23:03.655 INFO:tasks.ceph.osd.3:Started 2024-09-17T04:23:03.656 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T04:23:03.656 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T04:23:03.658 INFO:tasks.ceph.osd.4:Started 2024-09-17T04:23:03.658 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T04:23:03.658 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T04:23:03.660 INFO:tasks.ceph.osd.5:Started 2024-09-17T04:23:03.661 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T04:23:03.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T04:23:03.663 INFO:tasks.ceph.osd.6:Started 2024-09-17T04:23:03.663 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T04:23:03.663 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T04:23:03.666 INFO:tasks.ceph.osd.7:Started 2024-09-17T04:23:03.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:03.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 -- 172.21.15.63:0/3679685958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f418006f4b0 msgr2=0x7f41800d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 --2- 172.21.15.63:0/3679685958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f418006f4b0 0x7f41800d3330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41800c7ff0 tx=0x7f417402a4f0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 -- 172.21.15.63:0/3679685958 shutdown_connections 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 --2- 172.21.15.63:0/3679685958 >> v2:172.21.15.112:3300/0 conn(0x7f41800d3870 0x7f41800ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 --2- 172.21.15.63:0/3679685958 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f418006f4b0 0x7f41800d3330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 --2- 172.21.15.63:0/3679685958 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f418006e170 0x7f41800b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 -- 172.21.15.63:0/3679685958 >> 172.21.15.63:0/3679685958 conn(0x7f418008bfc0 msgr2=0x7f418009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 -- 172.21.15.63:0/3679685958 shutdown_connections 2024-09-17T04:23:03.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.822+0000 7f4186732640 1 -- 172.21.15.63:0/3679685958 wait complete. 2024-09-17T04:23:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.824+0000 7f4186732640 1 Processor -- start 2024-09-17T04:23:03.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.824+0000 7f4186732640 1 -- start start 2024-09-17T04:23:03.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 0x7f41800a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cd650 0x7f41800b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:03.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f41800cf490 con 0x7f41800d3870 2024-09-17T04:23:03.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f41800cf310 con 0x7f418006f4b0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4186732640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f41800d0ce0 con 0x7f41800cd650 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 0x7f41800a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39334/0 (socket says 172.21.15.63:39334) 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417f7fe640 1 -- 172.21.15.63:0/3397087749 learned_addr learned my addr 172.21.15.63:0/3397087749 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f4184ccf640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cd650 0x7f41800b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 -- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cd650 msgr2=0x7f41800b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cd650 0x7f41800b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 -- 172.21.15.63:0/3397087749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 msgr2=0x7f41800cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417ffff640 1 -- 172.21.15.63:0/3397087749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41801f52b0 con 0x7f418006f4b0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.826+0000 7f417f7fe640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417ffff640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 0x7f41800a1940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f417000e730 tx=0x7f417000eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:03.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417000cab0 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f417000cd40 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170010690 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41801f5590 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41801f5b50 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4170010830 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.827+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4170018420 con 0x7f418006f4b0 2024-09-17T04:23:03.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.828+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418006e170 con 0x7f418006f4b0 2024-09-17T04:23:03.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.831+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4170018620 con 0x7f418006f4b0 2024-09-17T04:23:03.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.892+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f418006cde0 con 0x7f418006f4b0 2024-09-17T04:23:03.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.893+0000 7f417cff9640 1 -- 172.21.15.63:0/3397087749 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4170010b20 con 0x7f418006f4b0 2024-09-17T04:23:03.894 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:03.894 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:03.633555+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 msgr2=0x7f41800a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 0x7f41800a1940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f417000e730 tx=0x7f417000eb30 comp rx=0 tx=0).stop 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 shutdown_connections 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f41800cd650 0x7f41800b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41800d3870 0x7f41800cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 --2- 172.21.15.63:0/3397087749 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f418006f4b0 0x7f41800a1940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 >> 172.21.15.63:0/3397087749 conn(0x7f418008bfc0 msgr2=0x7f4180068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 shutdown_connections 2024-09-17T04:23:03.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:03.894+0000 7f4186732640 1 -- 172.21.15.63:0/3397087749 wait complete. 2024-09-17T04:23:03.905 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T04:23:03.905 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T04:23:04.653 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-17T04:23:04.653+0000 7f42dfe1b640 -1 Falling back to public interface 2024-09-17T04:23:04.711 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 -- 172.21.15.63:0/2210619645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 msgr2=0x7f7264004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 --2- 172.21.15.63:0/2210619645 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f7264004060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f726c001830 tx=0x7f7264005830 comp rx=0 tx=0).stop 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f72808c8640 1 -- 172.21.15.63:0/2210619645 reap_dead start 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 -- 172.21.15.63:0/2210619645 shutdown_connections 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 -- 172.21.15.63:0/2210619645 >> 172.21.15.63:0/2210619645 conn(0x7f727c0b6780 msgr2=0x7f727c0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:04.822 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 -- 172.21.15.63:0/2210619645 shutdown_connections 2024-09-17T04:23:04.823 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.821+0000 7f728232b640 1 -- 172.21.15.63:0/2210619645 wait complete. 2024-09-17T04:23:04.823 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.822+0000 7f728232b640 1 Processor -- start 2024-09-17T04:23:04.823 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.823+0000 7f728232b640 1 -- start start 2024-09-17T04:23:04.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f727c1f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:04.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:04.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f727c0ccaa0 0x7f727c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:04.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f727c0b1260 con 0x7f727c148840 2024-09-17T04:23:04.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f727c0b10e0 con 0x7f7264003c10 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f728232b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f727c0b13e0 con 0x7f727c0ccaa0 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39356/0 (socket says 172.21.15.63:39356) 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f727b7fe640 1 -- 172.21.15.63:0/1143364243 learned_addr learned my addr 172.21.15.63:0/1143364243 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f727bfff640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f727c1f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.824+0000 7f72808c8640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f727c0ccaa0 0x7f727c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 -- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f727c0ccaa0 msgr2=0x7f727c1f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f727c0ccaa0 0x7f727c1f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 -- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 msgr2=0x7f727c1f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f727c1f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 -- 172.21.15.63:0/1143364243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c1f5410 con 0x7f727c148840 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727bfff640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f727c1f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:04.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f727b7fe640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7270011ae0 tx=0x7f7270011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000fe70 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7270004050 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c159c60 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72700044a0 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.825+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c1f9490 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.826+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c1f8f20 con 0x7f727c148840 2024-09-17T04:23:04.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.826+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f72700035f0 con 0x7f727c148840 2024-09-17T04:23:04.829 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.826+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f72700530c0 con 0x7f727c148840 2024-09-17T04:23:04.829 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.828+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f727001dc30 con 0x7f727c148840 2024-09-17T04:23:04.892 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.891+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f727c15b640 con 0x7f727c148840 2024-09-17T04:23:04.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.892+0000 7f7278ff9640 1 -- 172.21.15.63:0/1143364243 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7270018da0 con 0x7f727c148840 2024-09-17T04:23:04.893 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T04:23:04.893 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:03.633555+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 msgr2=0x7f727c159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7270011ae0 tx=0x7f7270011ee0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 shutdown_connections 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f727c0ccaa0 0x7f727c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f727c148840 0x7f727c159720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 --2- 172.21.15.63:0/1143364243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7264003c10 0x7f727c1f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 >> 172.21.15.63:0/1143364243 conn(0x7f727c0b6780 msgr2=0x7f727c071660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 shutdown_connections 2024-09-17T04:23:04.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:04.893+0000 7f728232b640 1 -- 172.21.15.63:0/1143364243 wait complete. 2024-09-17T04:23:04.903 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T04:23:05.105 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-17T04:23:05.104+0000 7f0724c18640 -1 Falling back to public interface 2024-09-17T04:23:05.119 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-17T04:23:05.119+0000 7f0283fdd640 -1 Falling back to public interface 2024-09-17T04:23:05.380 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-17T04:23:05.380+0000 7feea5a0b640 -1 Falling back to public interface 2024-09-17T04:23:05.396 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-17T04:23:05.396+0000 7f47e640c640 -1 Falling back to public interface 2024-09-17T04:23:05.401 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-17T04:23:05.400+0000 7fd578411640 -1 Falling back to public interface 2024-09-17T04:23:05.402 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-17T04:23:05.402+0000 7f1753c8f640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T04:23:05.403 INFO:tasks.ceph.mgr.x.smithi112.stderr:2024-09-17T04:23:05.403+0000 7f1753c8f640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T04:23:05.598 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-17T04:23:05.598+0000 7f3e55e14640 -1 Falling back to public interface 2024-09-17T04:23:05.658 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-17T04:23:05.658+0000 7f1ceb0ef640 -1 Falling back to public interface 2024-09-17T04:23:08.441 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-17T04:23:08.441+0000 7f42dfe1b640 -1 osd.5 0 log_to_monitors true 2024-09-17T04:23:08.850 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-17T04:23:08.849+0000 7f0724c18640 -1 osd.1 0 log_to_monitors true 2024-09-17T04:23:09.161 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-17T04:23:09.161+0000 7f0283fdd640 -1 osd.6 0 log_to_monitors true 2024-09-17T04:23:09.348 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-17T04:23:09.348+0000 7f3e55e14640 -1 osd.4 0 log_to_monitors true 2024-09-17T04:23:09.391 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-17T04:23:09.391+0000 7feea5a0b640 -1 osd.7 0 log_to_monitors true 2024-09-17T04:23:09.471 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-17T04:23:09.470+0000 7fd578411640 -1 osd.0 0 log_to_monitors true 2024-09-17T04:23:09.476 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-17T04:23:09.476+0000 7f47e640c640 -1 osd.3 0 log_to_monitors true 2024-09-17T04:23:09.702 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-17T04:23:09.701+0000 7f1ceb0ef640 -1 osd.2 0 log_to_monitors true 2024-09-17T04:23:10.933 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-17T04:23:10.933+0000 7f42dc01c640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T04:23:10.941 INFO:tasks.ceph.osd.5.smithi112.stderr:2024-09-17T04:23:10.942+0000 7f42d35fd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:10.966 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-17T04:23:10.966+0000 7f0720579640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T04:23:10.976 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-17T04:23:10.976+0000 7f071836f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:11.709 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 -- 172.21.15.63:0/2108255995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 msgr2=0x7f482c0cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 --2- 172.21.15.63:0/2108255995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c0cc520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4820009830 tx=0x7f482002a480 comp rx=0 tx=0).stop 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 -- 172.21.15.63:0/2108255995 shutdown_connections 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 --2- 172.21.15.63:0/2108255995 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0cca60 0x7f482c15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 --2- 172.21.15.63:0/2108255995 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c0cc520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 -- 172.21.15.63:0/2108255995 >> 172.21.15.63:0/2108255995 conn(0x7f482c0b2ed0 msgr2=0x7f482c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:11.826 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 -- 172.21.15.63:0/2108255995 shutdown_connections 2024-09-17T04:23:11.827 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.825+0000 7f4831669640 1 -- 172.21.15.63:0/2108255995 wait complete. 2024-09-17T04:23:11.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.827+0000 7f4831669640 1 Processor -- start 2024-09-17T04:23:11.828 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.827+0000 7f4831669640 1 -- start start 2024-09-17T04:23:11.830 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 0x7f482c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 0x7f482c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f482c0cd200 con 0x7f482c0cca60 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f482c0cd080 con 0x7f482c0b0cc0 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f4831669640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f482c15fa70 con 0x7f482c0b6720 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482a7fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 0x7f482c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 0x7f482c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:35142/0 (socket says 172.21.15.63:35142) 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482a7fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 0x7f482c158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:35664/0 (socket says 172.21.15.63:35664) 2024-09-17T04:23:11.831 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 0x7f482c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46066/0 (socket says 172.21.15.63:46066) 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 -- 172.21.15.63:0/1847640640 learned_addr learned my addr 172.21.15.63:0/1847640640 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 -- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 msgr2=0x7f482c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 0x7f482c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 -- 172.21.15.63:0/1847640640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 msgr2=0x7f482c0cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 0x7f482c0cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 -- 172.21.15.63:0/1847640640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c1f6300 con 0x7f482c0b0cc0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.829+0000 7f482affd640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f481c0016a0 tx=0x7f481c001b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.830+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c005280 con 0x7f482c0b0cc0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.830+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f481c005420 con 0x7f482c0b0cc0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.830+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482c1f65e0 con 0x7f482c0b0cc0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.830+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c010870 con 0x7f482c0b0cc0 2024-09-17T04:23:11.832 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.830+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482c09dfc0 con 0x7f482c0b0cc0 2024-09-17T04:23:11.833 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.831+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482c09dad0 con 0x7f482c0b0cc0 2024-09-17T04:23:11.833 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.832+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f481c010a10 con 0x7f482c0b0cc0 2024-09-17T04:23:11.834 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.833+0000 7f48137fe640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 0x7f481807b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:11.834 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.833+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2791+0+0 (secure 0 0 0) 0x7f481c09d8f0 con 0x7f482c0b0cc0 2024-09-17T04:23:11.834 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.833+0000 7f482a7fc640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 0x7f481807b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:11.834 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.834+0000 7f482a7fc640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 0x7f481807b010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f4820004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:11.838 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:11.837+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f481c0663b0 con 0x7f482c0b0cc0 2024-09-17T04:23:12.049 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.048+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f482c0cc520 con 0x7f482c0b0cc0 2024-09-17T04:23:12.049 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.049+0000 7f48137fe640 1 -- 172.21.15.63:0/1847640640 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8041 (secure 0 0 0) 0x7f481c06ade0 con 0x7f482c0b0cc0 2024-09-17T04:23:12.050 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T04:23:12.050 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":13,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:11.045298+0000","last_up_change":"2024-09-17T04:23:11.045298+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:12.052 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.051+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 msgr2=0x7f481807b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.051+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 0x7f481807b010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4820034000 tx=0x7f4820004730 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.051+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 msgr2=0x7f482c1f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.051+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f481c0016a0 tx=0x7f481c001b60 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 shutdown_connections 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4818078b00 0x7f481807b010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f482c0cca60 0x7f482c0cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f482c0b6720 0x7f482c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 --2- 172.21.15.63:0/1847640640 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f482c0b0cc0 0x7f482c1f5810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 >> 172.21.15.63:0/1847640640 conn(0x7f482c0b2ed0 msgr2=0x7f482c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 shutdown_connections 2024-09-17T04:23:12.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:12.052+0000 7f4831669640 1 -- 172.21.15.63:0/1847640640 wait complete. 2024-09-17T04:23:12.066 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-17T04:23:12.792 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-17T04:23:12.792+0000 7f0280780640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T04:23:12.804 INFO:tasks.ceph.osd.6.smithi112.stderr:2024-09-17T04:23:12.805+0000 7f0277d61640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:12.808 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-17T04:23:12.807+0000 7f1ce7892640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T04:23:12.817 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-17T04:23:12.817+0000 7feea12fd640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T04:23:12.823 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-17T04:23:12.823+0000 7f1cdee73640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:12.826 INFO:tasks.ceph.osd.7.smithi112.stderr:2024-09-17T04:23:12.827+0000 7fee990f3640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:12.839 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-17T04:23:12.839+0000 7f3e5169e640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T04:23:12.859 INFO:tasks.ceph.osd.4.smithi112.stderr:2024-09-17T04:23:12.859+0000 7f3e49494640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:12.872 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-17T04:23:12.871+0000 7fd5745a6640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T04:23:12.880 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-17T04:23:12.880+0000 7f47e1dd8640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T04:23:12.885 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-17T04:23:12.885+0000 7fd56bb87640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:12.893 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-17T04:23:12.894+0000 7f47d9bce640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T04:23:18.874 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:18.995 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 -- 172.21.15.63:0/3592238913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae40b35d0 msgr2=0x7feae40b9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:18.995 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 --2- 172.21.15.63:0/3592238913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae40b35d0 0x7feae40b9ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feae40d1060 tx=0x7fead402a4b0 comp rx=0 tx=0).stop 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 -- 172.21.15.63:0/3592238913 shutdown_connections 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 --2- 172.21.15.63:0/3592238913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae41632a0 0x7feae40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 --2- 172.21.15.63:0/3592238913 >> v2:172.21.15.112:3300/0 conn(0x7feae4162950 0x7feae4162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 --2- 172.21.15.63:0/3592238913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae40b35d0 0x7feae40b9ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 -- 172.21.15.63:0/3592238913 >> 172.21.15.63:0/3592238913 conn(0x7feae40d4660 msgr2=0x7feae40d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 -- 172.21.15.63:0/3592238913 shutdown_connections 2024-09-17T04:23:18.996 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.995+0000 7feae89cc640 1 -- 172.21.15.63:0/3592238913 wait complete. 2024-09-17T04:23:18.997 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.997+0000 7feae89cc640 1 Processor -- start 2024-09-17T04:23:18.997 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.997+0000 7feae89cc640 1 -- start start 2024-09-17T04:23:19.002 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae40b35d0 0x7feae40cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.002 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 0x7feae4156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.002 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feae40cfb60 con 0x7feae41632a0 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7feae40cf9e0 con 0x7feae40b35d0 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae89cc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7feae40cfce0 con 0x7feae4162950 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46084/0 (socket says 172.21.15.63:46084) 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 -- 172.21.15.63:0/4277969895 learned_addr learned my addr 172.21.15.63:0/4277969895 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae259c640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae40b35d0 0x7feae40cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae1d9b640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 0x7feae4156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 -- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 msgr2=0x7feae4156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 0x7feae4156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 -- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae40b35d0 msgr2=0x7feae40cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae40b35d0 0x7feae40cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.003 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 -- 172.21.15.63:0/4277969895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae40a1fb0 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae1d9b640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 0x7feae4156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7feae2d9d640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e960 tx=0x7feadc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:18.999+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc004d20 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.000+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feadc00cac0 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.000+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae409e550 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.000+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc005020 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.000+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae409eb10 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.001+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae4162d60 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.001+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feadc0051c0 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.002+0000 7fead2ffd640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 0x7feac407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.002+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feadc09b220 con 0x7feae41632a0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.002+0000 7feae259c640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 0x7feac407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.004 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.003+0000 7feae259c640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 0x7feac407b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fead4034000 tx=0x7fead4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:19.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.007+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feadc016030 con 0x7feae41632a0 2024-09-17T04:23:19.193 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.193+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feae40d5250 con 0x7feae41632a0 2024-09-17T04:23:19.193 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.194+0000 7fead2ffd640 1 -- 172.21.15.63:0/4277969895 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7feadc063360 con 0x7feae41632a0 2024-09-17T04:23:19.194 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-17T04:23:19.194 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":17,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:15.225906+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 msgr2=0x7feac407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 0x7feac407b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fead4034000 tx=0x7fead4004730 comp rx=0 tx=0).stop 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 msgr2=0x7feae40cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feadc00e960 tx=0x7feadc00ee20 comp rx=0 tx=0).stop 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 shutdown_connections 2024-09-17T04:23:19.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7feac4078b90 0x7feac407b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feae41632a0 0x7feae40cdb40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7feae4162950 0x7feae4156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 --2- 172.21.15.63:0/4277969895 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7feae40b35d0 0x7feae40cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 >> 172.21.15.63:0/4277969895 conn(0x7feae40d4660 msgr2=0x7feae406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 shutdown_connections 2024-09-17T04:23:19.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-17T04:23:19.196+0000 7feae89cc640 1 -- 172.21.15.63:0/4277969895 wait complete. 2024-09-17T04:23:19.206 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T04:23:19.206 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T04:23:19.206 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T04:23:19.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T04:23:19.209 INFO:tasks.ceph.mds.a:Started 2024-09-17T04:23:19.209 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T04:23:19.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T04:23:19.211 INFO:tasks.ceph.mds.c:Started 2024-09-17T04:23:19.211 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T04:23:19.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T04:23:19.214 INFO:tasks.ceph.mds.b:Started 2024-09-17T04:23:19.214 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T04:23:19.215 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T04:23:19.217 INFO:tasks.ceph.mds.d:Started 2024-09-17T04:23:19.217 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T04:23:19.217 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:19.298 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-17T04:23:19.302 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-09-17T04:23:19.313 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-09-17T04:23:19.313 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-09-17T04:23:19.314 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-09-17T04:23:19.314+0000 7f7dd0b78640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T04:23:19.314 INFO:tasks.ceph.mds.d.smithi112.stderr:2024-09-17T04:23:19.314+0000 7f85ccfe5640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 -- 172.21.15.63:0/1501299979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc15c890 msgr2=0x7fd7bc0b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 --2- 172.21.15.63:0/1501299979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc15c890 0x7fd7bc0b51c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0741f0 tx=0x7fd7b002a560 comp rx=0 tx=0).stop 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 -- 172.21.15.63:0/1501299979 shutdown_connections 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 --2- 172.21.15.63:0/1501299979 >> v2:172.21.15.112:3300/0 conn(0x7fd7bc0ccbd0 0x7fd7bc0cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 --2- 172.21.15.63:0/1501299979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc15c890 0x7fd7bc0b51c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.340+0000 7fd7c387e640 1 -- 172.21.15.63:0/1501299979 >> 172.21.15.63:0/1501299979 conn(0x7fd7bc072aa0 msgr2=0x7fd7bc072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.341+0000 7fd7c387e640 1 -- 172.21.15.63:0/1501299979 shutdown_connections 2024-09-17T04:23:19.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.341+0000 7fd7c387e640 1 -- 172.21.15.63:0/1501299979 wait complete. 2024-09-17T04:23:19.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.342+0000 7fd7c387e640 1 Processor -- start 2024-09-17T04:23:19.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.342+0000 7fd7c387e640 1 -- start start 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 0x7fd7bc0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7bc15c890 0x7fd7bc14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc0cfaf0 con 0x7fd7bc0ccbd0 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7bc0cf970 con 0x7fd7bc0cf130 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c387e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd7bc0d15e0 con 0x7fd7bc15c890 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c161a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 0x7fd7bc0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c161a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 0x7fd7bc0b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46108/0 (socket says 172.21.15.63:46108) 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:35212/0 (socket says 172.21.15.63:35212) 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 -- 172.21.15.63:0/3887073576 learned_addr learned my addr 172.21.15.63:0/3887073576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:19.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c1e1b640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7bc15c890 0x7fd7bc14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 -- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7bc15c890 msgr2=0x7fd7bc14ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7bc15c890 0x7fd7bc14ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 -- 172.21.15.63:0/3887073576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 msgr2=0x7fd7bc0b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 0x7fd7bc0b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 -- 172.21.15.63:0/3887073576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7bc0cca00 con 0x7fd7bc0cf130 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7c0e19640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009fd0 tx=0x7fd7b800ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.344+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800ccc0 con 0x7fd7bc0cf130 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.345+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b800ee70 con 0x7fd7bc0cf130 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.345+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7bc0c9a70 con 0x7fd7bc0cf130 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.345+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800ce60 con 0x7fd7bc0cf130 2024-09-17T04:23:19.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.345+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7bc0c8560 con 0x7fd7bc0cf130 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.346+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7bc0cd460 con 0x7fd7bc0cf130 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.346+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7b8005260 con 0x7fd7bc0cf130 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.347+0000 7fd7adffb640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.347+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd7b809b120 con 0x7fd7bc0cf130 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.347+0000 7fd7c161a640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:19.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.348+0000 7fd7c161a640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0033000 tx=0x7fd7b0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:19.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.352+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7bc0cd460 con 0x7fd7bc0cf130 2024-09-17T04:23:19.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.577+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7bc14b020 con 0x7fd7bc0cf130 2024-09-17T04:23:19.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.577+0000 7fd7adffb640 1 -- 172.21.15.63:0/3887073576 <== mon.1 v2:172.21.15.112:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7fd7bc14b020 con 0x7fd7bc0cf130 2024-09-17T04:23:19.577 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:19.577 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-17T04:23:19:304455+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T04:23:19.577 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-17T04:23:19.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 msgr2=0x7fd7a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0033000 tx=0x7fd7b0004730 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 msgr2=0x7fd7bc0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8009fd0 tx=0x7fd7b800ec20 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 shutdown_connections 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7bc0cf130 0x7fd7bc0cc350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7bc15c890 0x7fd7bc14ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 --2- 172.21.15.63:0/3887073576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7bc0ccbd0 0x7fd7bc0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 >> 172.21.15.63:0/3887073576 conn(0x7fd7bc072aa0 msgr2=0x7fd7bc0b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.579+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 shutdown_connections 2024-09-17T04:23:19.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:19.580+0000 7fd7c387e640 1 -- 172.21.15.63:0/3887073576 wait complete. 2024-09-17T04:23:21.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:23:21.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:23:21.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:21.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 -- 172.21.15.63:0/509836576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d6c004800 msgr2=0x7f4d6c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:21.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/509836576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d6c004800 0x7f4d6c004c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4d84074810 tx=0x7f4d6c005830 comp rx=0 tx=0).stop 2024-09-17T04:23:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8887b640 1 -- 172.21.15.63:0/509836576 reap_dead start 2024-09-17T04:23:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 -- 172.21.15.63:0/509836576 shutdown_connections 2024-09-17T04:23:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 -- 172.21.15.63:0/509836576 >> 172.21.15.63:0/509836576 conn(0x7f4d8406d4f0 msgr2=0x7f4d84071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 -- 172.21.15.63:0/509836576 shutdown_connections 2024-09-17T04:23:21.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.723+0000 7f4d8a2de640 1 -- 172.21.15.63:0/509836576 wait complete. 2024-09-17T04:23:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.725+0000 7f4d8a2de640 1 Processor -- start 2024-09-17T04:23:21.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.725+0000 7f4d8a2de640 1 -- start start 2024-09-17T04:23:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d6c004800 0x7f4d840a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d8414f510 0x7f4d840cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840d1210 con 0x7f4d8415d0e0 2024-09-17T04:23:21.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840d1090 con 0x7f4d8414f510 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8a2de640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840d1390 con 0x7f4d6c004800 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48360/0 (socket says 172.21.15.63:48360) 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 -- 172.21.15.63:0/3582986566 learned_addr learned my addr 172.21.15.63:0/3582986566 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d83fff640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d6c004800 0x7f4d840a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d8887b640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d8414f510 0x7f4d840cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 -- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d6c004800 msgr2=0x7f4d840a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d6c004800 0x7f4d840a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 -- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d8414f510 msgr2=0x7f4d840cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d8414f510 0x7f4d840cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 -- 172.21.15.63:0/3582986566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d84158d20 con 0x7f4d8415d0e0 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.727+0000 7f4d837fe640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c350 tx=0x7f4d78001180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:21.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.728+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78031040 con 0x7f4d8415d0e0 2024-09-17T04:23:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.728+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d78003610 con 0x7f4d8415d0e0 2024-09-17T04:23:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.728+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78003a60 con 0x7f4d8415d0e0 2024-09-17T04:23:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.728+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d841f4440 con 0x7f4d8415d0e0 2024-09-17T04:23:21.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.728+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8415c600 con 0x7f4d8415d0e0 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.729+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d840d18f0 con 0x7f4d8415d0e0 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.730+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d78034070 con 0x7f4d8415d0e0 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.730+0000 7f4d80ff9640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 0x7f4d7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.730+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4d780baae0 con 0x7f4d8415d0e0 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.730+0000 7f4d83fff640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 0x7f4d7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:21.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.731+0000 7f4d83fff640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 0x7f4d7007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d74006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:21.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.735+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d78082e20 con 0x7f4d8415d0e0 2024-09-17T04:23:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.955+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d8415bfc0 con 0x7f4d8415d0e0 2024-09-17T04:23:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.956+0000 7f4d80ff9640 1 -- 172.21.15.63:0/3582986566 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f4d78087850 con 0x7f4d8415d0e0 2024-09-17T04:23:21.956 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:21.956 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"btime":"2024-09-17T04:23:20:307941+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4393,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T04:23:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-09-17T04:23:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 msgr2=0x7f4d7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 0x7f4d7007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4d74000c00 tx=0x7f4d74006b70 comp rx=0 tx=0).stop 2024-09-17T04:23:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 msgr2=0x7f4d8415dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c350 tx=0x7f4d78001180 comp rx=0 tx=0).stop 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 shutdown_connections 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4d70078b90 0x7f4d7007b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4d8414f510 0x7f4d840cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d8415d0e0 0x7f4d8415dd10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 --2- 172.21.15.63:0/3582986566 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4d6c004800 0x7f4d840a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 >> 172.21.15.63:0/3582986566 conn(0x7f4d8406d4f0 msgr2=0x7f4d84160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 shutdown_connections 2024-09-17T04:23:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:21.958+0000 7f4d8a2de640 1 -- 172.21.15.63:0/3582986566 wait complete. 2024-09-17T04:23:21.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T04:23:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 -- 172.21.15.63:0/2546761472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0b9b70 msgr2=0x7f09ec0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2546761472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0b9b70 0x7f09ec0cf090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09ec08d4e0 tx=0x7f09e002a530 comp rx=0 tx=0).stop 2024-09-17T04:23:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 -- 172.21.15.63:0/2546761472 shutdown_connections 2024-09-17T04:23:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2546761472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0b9b70 0x7f09ec0cf090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2546761472 >> v2:172.21.15.112:3300/0 conn(0x7f09ec0d2ed0 0x7f09ec0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 -- 172.21.15.63:0/2546761472 >> 172.21.15.63:0/2546761472 conn(0x7f09ec08bfc0 msgr2=0x7f09ec09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 -- 172.21.15.63:0/2546761472 shutdown_connections 2024-09-17T04:23:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.086+0000 7f09f1abe640 1 -- 172.21.15.63:0/2546761472 wait complete. 2024-09-17T04:23:22.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.088+0000 7f09f1abe640 1 Processor -- start 2024-09-17T04:23:22.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.088+0000 7f09f1abe640 1 -- start start 2024-09-17T04:23:22.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09ec0b9b70 0x7f09ec1f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0d2ed0 0x7f09ec0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0cfe80 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0cfd00 con 0x7f09ec0d2ed0 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.089+0000 7f09f1abe640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec0d4940 con 0x7f09ec0b9b70 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48380/0 (socket says 172.21.15.63:48380) 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 -- 172.21.15.63:0/2267353809 learned_addr learned my addr 172.21.15.63:0/2267353809 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eb7fe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09ec0b9b70 0x7f09ec1f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09ebfff640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0d2ed0 0x7f09ec0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 -- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09ec0b9b70 msgr2=0x7f09ec1f9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09ec0b9b70 0x7f09ec1f9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 -- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0d2ed0 msgr2=0x7f09ec0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0d2ed0 0x7f09ec0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 -- 172.21.15.63:0/2267353809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec1f5b50 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09eaffd640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098f0 tx=0x7f09e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0031d60 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09e0033e10 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec1f5dd0 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0005260 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.090+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec1f6390 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.091+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec1e91e0 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.092+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09e0005400 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.093+0000 7f09d3fff640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 0x7f09d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.093+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f09e00bbc00 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.093+0000 7f09eb7fe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 0x7f09d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.093+0000 7f09eb7fe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 0x7f09d807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00bb30 tx=0x7f09dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:22.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.097+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09e00c2080 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.286+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f09ec0d4e40 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.286+0000 7f09d3fff640 1 -- 172.21.15.63:0/2267353809 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f09ec1f5b50 con 0x7f09ec0cf5d0 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:23:22.286 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-17T04:23:22.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 msgr2=0x7f09d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 0x7f09d807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00bb30 tx=0x7f09dc00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 msgr2=0x7f09ec1e8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09e00098f0 tx=0x7f09e0033c20 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 shutdown_connections 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f09d8078b90 0x7f09d807b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f09ec0d2ed0 0x7f09ec0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09ec0cf5d0 0x7f09ec1e8c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 --2- 172.21.15.63:0/2267353809 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f09ec0b9b70 0x7f09ec1f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.288+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 >> 172.21.15.63:0/2267353809 conn(0x7f09ec08bfc0 msgr2=0x7f09ec06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.289+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 shutdown_connections 2024-09-17T04:23:22.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.289+0000 7f09f1abe640 1 -- 172.21.15.63:0/2267353809 wait complete. 2024-09-17T04:23:22.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T04:23:22.300 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T04:23:22.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.420+0000 7f99e68e5640 1 -- 172.21.15.63:0/1521907640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00ccb50 msgr2=0x7f99e00ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.420+0000 7f99e68e5640 1 --2- 172.21.15.63:0/1521907640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00ccb50 0x7f99e00ccf60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99d8005fd0 tx=0x7f99d802aa10 comp rx=0 tx=0).stop 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.420+0000 7f99e68e5640 1 -- 172.21.15.63:0/1521907640 shutdown_connections 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.420+0000 7f99e68e5640 1 --2- 172.21.15.63:0/1521907640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00ccb50 0x7f99e00ccf60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.420+0000 7f99e68e5640 1 -- 172.21.15.63:0/1521907640 >> 172.21.15.63:0/1521907640 conn(0x7f99e00b3ea0 msgr2=0x7f99e00b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.421+0000 7f99e68e5640 1 -- 172.21.15.63:0/1521907640 shutdown_connections 2024-09-17T04:23:22.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.421+0000 7f99e68e5640 1 -- 172.21.15.63:0/1521907640 wait complete. 2024-09-17T04:23:22.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.422+0000 7f99e68e5640 1 Processor -- start 2024-09-17T04:23:22.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.422+0000 7f99e68e5640 1 -- start start 2024-09-17T04:23:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 0x7f99e015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 0x7f99e01e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00d0250 con 0x7f99e00d1d60 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f99e00d00d0 con 0x7f99e015c5e0 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e68e5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f99e00d03d0 con 0x7f99e00ccb50 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48398/0 (socket says 172.21.15.63:48398) 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 -- 172.21.15.63:0/2447381255 learned_addr learned my addr 172.21.15.63:0/2447381255 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e4e82640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 0x7f99e01e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99dffff640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 0x7f99e015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 -- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 msgr2=0x7f99e015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 0x7f99e015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 -- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 msgr2=0x7f99e01e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 0x7f99e01e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 -- 172.21.15.63:0/2447381255 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e00b51a0 con 0x7f99e00d1d60 2024-09-17T04:23:22.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99dffff640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 0x7f99e015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99e4e82640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 0x7f99e01e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99df7fe640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99d400c400 tx=0x7f99d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.424+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4017070 con 0x7f99e00d1d60 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.425+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d40053c0 con 0x7f99e00d1d60 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.425+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e00c7910 con 0x7f99e00d1d60 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.425+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4003850 con 0x7f99e00d1d60 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.425+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e00c7ed0 con 0x7f99e00d1d60 2024-09-17T04:23:22.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.426+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e00d08f0 con 0x7f99e00d1d60 2024-09-17T04:23:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.426+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99d401a070 con 0x7f99e00d1d60 2024-09-17T04:23:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.427+0000 7f99dcff9640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 0x7f99cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.427+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f99d4099d60 con 0x7f99e00d1d60 2024-09-17T04:23:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.427+0000 7f99dffff640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 0x7f99cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:22.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.428+0000 7f99dffff640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 0x7f99cc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99d0000f60 tx=0x7f99d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:22.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.432+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99d4062580 con 0x7f99e00d1d60 2024-09-17T04:23:22.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:22.618+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f99e00cd280 con 0x7f99e00d1d60 2024-09-17T04:23:23.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.326+0000 7f99dcff9640 1 -- 172.21.15.63:0/2447381255 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f99d4061e80 con 0x7f99e00d1d60 2024-09-17T04:23:23.326 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 msgr2=0x7f99cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 0x7f99cc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f99d0000f60 tx=0x7f99d0009040 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 msgr2=0x7f99e00cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99d400c400 tx=0x7f99d400c8c0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 shutdown_connections 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f99cc078b90 0x7f99cc07b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f99e015c5e0 0x7f99e01e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99e00d1d60 0x7f99e00cbb20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 --2- 172.21.15.63:0/2447381255 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f99e00ccb50 0x7f99e015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 >> 172.21.15.63:0/2447381255 conn(0x7f99e00b3ea0 msgr2=0x7f99e00b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 shutdown_connections 2024-09-17T04:23:23.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.329+0000 7f99e68e5640 1 -- 172.21.15.63:0/2447381255 wait complete. 2024-09-17T04:23:23.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T04:23:23.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 -- 172.21.15.63:0/1906549686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 msgr2=0x7f236c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:23.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 --2- 172.21.15.63:0/1906549686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0d1a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2368005fd0 tx=0x7f236802aa10 comp rx=0 tx=0).stop 2024-09-17T04:23:23.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 -- 172.21.15.63:0/1906549686 shutdown_connections 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 --2- 172.21.15.63:0/1906549686 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 0x7f236c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 --2- 172.21.15.63:0/1906549686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0d1a80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 -- 172.21.15.63:0/1906549686 >> 172.21.15.63:0/1906549686 conn(0x7f236c08bfc0 msgr2=0x7f236c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 -- 172.21.15.63:0/1906549686 shutdown_connections 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.475+0000 7f2374557640 1 -- 172.21.15.63:0/1906549686 wait complete. 2024-09-17T04:23:23.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.477+0000 7f2374557640 1 Processor -- start 2024-09-17T04:23:23.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.477+0000 7f2374557640 1 -- start start 2024-09-17T04:23:23.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 0x7f236c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:23.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f236c0cf5d0 0x7f236c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:23.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f236c0d4940 con 0x7f236c0d2ed0 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f236c0cfde0 con 0x7f236c0cf5d0 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.478+0000 7f2374557640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f236c0d4ac0 con 0x7f236c0b9b70 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48422/0 (socket says 172.21.15.63:48422) 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 -- 172.21.15.63:0/4019200993 learned_addr learned my addr 172.21.15.63:0/4019200993 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f23722f3640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 0x7f236c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2371af2640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f236c0cf5d0 0x7f236c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 -- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 msgr2=0x7f236c155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 0x7f236c155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 -- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f236c0cf5d0 msgr2=0x7f236c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f236c0cf5d0 0x7f236c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:23.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 -- 172.21.15.63:0/4019200993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c0ce6a0 con 0x7f236c0d2ed0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2372af4640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f236400c3c0 tx=0x7f236400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364017070 con 0x7f236c0d2ed0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23640053c0 con 0x7f236c0d2ed0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2364003850 con 0x7f236c0d2ed0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c0ce980 con 0x7f236c0d2ed0 2024-09-17T04:23:23.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.479+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c0c8470 con 0x7f236c0d2ed0 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.480+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f236c0d5050 con 0x7f236c0d2ed0 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.481+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f236401a070 con 0x7f236c0d2ed0 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.481+0000 7f2362ffd640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 0x7f235007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.482+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f2364099d70 con 0x7f236c0d2ed0 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.482+0000 7f23722f3640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 0x7f235007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:23.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.482+0000 7f23722f3640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 0x7f235007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2368035000 tx=0x7f236803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:23.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.486+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2364061dd0 con 0x7f236c0d2ed0 2024-09-17T04:23:23.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:23.674+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f236c0b4020 con 0x7f236c0d2ed0 2024-09-17T04:23:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.328+0000 7f2362ffd640 1 -- 172.21.15.63:0/4019200993 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f2364066800 con 0x7f236c0d2ed0 2024-09-17T04:23:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-17T04:23:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.330+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 msgr2=0x7f235007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.330+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 0x7f235007b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2368035000 tx=0x7f236803b040 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.330+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 msgr2=0x7f236c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.330+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f236400c3c0 tx=0x7f236400c880 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 shutdown_connections 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2350078b90 0x7f235007b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f236c0cf5d0 0x7f236c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f236c0d2ed0 0x7f236c0cb890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 --2- 172.21.15.63:0/4019200993 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f236c0b9b70 0x7f236c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 >> 172.21.15.63:0/4019200993 conn(0x7f236c08bfc0 msgr2=0x7f236c0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 shutdown_connections 2024-09-17T04:23:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.331+0000 7f2374557640 1 -- 172.21.15.63:0/4019200993 wait complete. 2024-09-17T04:23:24.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 -- 172.21.15.63:0/2108339138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 msgr2=0x7f86140b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 --2- 172.21.15.63:0/2108339138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f86140b9900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f861408d780 tx=0x7f861002a540 comp rx=0 tx=0).stop 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 -- 172.21.15.63:0/2108339138 shutdown_connections 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 --2- 172.21.15.63:0/2108339138 >> v2:172.21.15.112:3300/0 conn(0x7f86140b66b0 0x7f861406e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 --2- 172.21.15.63:0/2108339138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f86140b9900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 -- 172.21.15.63:0/2108339138 >> 172.21.15.63:0/2108339138 conn(0x7f861409d830 msgr2=0x7f86140d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:24.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 -- 172.21.15.63:0/2108339138 shutdown_connections 2024-09-17T04:23:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.479+0000 7f861c6ec640 1 -- 172.21.15.63:0/2108339138 wait complete. 2024-09-17T04:23:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.481+0000 7f861c6ec640 1 Processor -- start 2024-09-17T04:23:24.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.481+0000 7f861c6ec640 1 -- start start 2024-09-17T04:23:24.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86140b3910 0x7f86141f9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:24.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:24.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 0x7f861415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f861406eae0 con 0x7f86140d4c30 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f861406e960 con 0x7f8614150b10 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861c6ec640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f861406ec60 con 0x7f86140b3910 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f8619c87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f8619c87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48438/0 (socket says 172.21.15.63:48438) 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f8619c87640 1 -- 172.21.15.63:0/3763554926 learned_addr learned my addr 172.21.15.63:0/3763554926 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861a488640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86140b3910 0x7f86141f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.482+0000 7f861ac89640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 0x7f861415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 -- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86140b3910 msgr2=0x7f86141f9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86140b3910 0x7f86141f9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 -- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 msgr2=0x7f861415f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:24.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 0x7f861415f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 -- 172.21.15.63:0/3763554926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861415c5f0 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f861ac89640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 0x7f861415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f8619c87640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f860400b420 tx=0x7f860400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604011830 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8604016070 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8614158f30 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604011d60 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.483+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861415b2f0 con 0x7f86140d4c30 2024-09-17T04:23:24.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.484+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861406f1f0 con 0x7f86140d4c30 2024-09-17T04:23:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.485+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f860401b460 con 0x7f86140d4c30 2024-09-17T04:23:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.485+0000 7f860affd640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 0x7f85f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.485+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f860409aa70 con 0x7f86140d4c30 2024-09-17T04:23:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.486+0000 7f861a488640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 0x7f85f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:24.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.486+0000 7f861a488640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 0x7f85f807b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8610034000 tx=0x7f8610004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.490+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8604062f10 con 0x7f86140d4c30 2024-09-17T04:23:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:24.711+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86140d42b0 con 0x7f86140d4c30 2024-09-17T04:23:25.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.354+0000 7f860affd640 1 -- 172.21.15.63:0/3763554926 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8604062810 con 0x7f86140d4c30 2024-09-17T04:23:25.354 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T04:23:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.358+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 msgr2=0x7f85f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.358+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 0x7f85f807b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8610034000 tx=0x7f8610004730 comp rx=0 tx=0).stop 2024-09-17T04:23:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.358+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 msgr2=0x7f861415c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.358+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f860400b420 tx=0x7f860400b8e0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 shutdown_connections 2024-09-17T04:23:25.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f85f8078b90 0x7f85f807b0a0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8610034000 tx=0x7f8610004730 comp rx=0 tx=0).stop 2024-09-17T04:23:25.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8614150b10 0x7f861415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f86140d4c30 0x7f861415c0b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 --2- 172.21.15.63:0/3763554926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f86140b3910 0x7f86141f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 >> 172.21.15.63:0/3763554926 conn(0x7f861409d830 msgr2=0x7f86140b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:25.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.359+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 shutdown_connections 2024-09-17T04:23:25.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.360+0000 7f861c6ec640 1 -- 172.21.15.63:0/3763554926 wait complete. 2024-09-17T04:23:25.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:25.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 -- 172.21.15.63:0/3434578172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9100ceb40 msgr2=0x7fe9100cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 --2- 172.21.15.63:0/3434578172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9100ceb40 0x7fe9100cef50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9100ba570 tx=0x7fe90802a5a0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 -- 172.21.15.63:0/3434578172 shutdown_connections 2024-09-17T04:23:25.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 --2- 172.21.15.63:0/3434578172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9100ceb40 0x7fe9100cef50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 --2- 172.21.15.63:0/3434578172 >> v2:172.21.15.112:3300/0 conn(0x7fe91006e170 0x7fe9100b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 -- 172.21.15.63:0/3434578172 >> 172.21.15.63:0/3434578172 conn(0x7fe91008bfc0 msgr2=0x7fe91009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:25.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 -- 172.21.15.63:0/3434578172 shutdown_connections 2024-09-17T04:23:25.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.498+0000 7fe9187c6640 1 -- 172.21.15.63:0/3434578172 wait complete. 2024-09-17T04:23:25.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.500+0000 7fe9187c6640 1 Processor -- start 2024-09-17T04:23:25.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.500+0000 7fe9187c6640 1 -- start start 2024-09-17T04:23:25.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe91006f4b0 0x7fe9100c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100ceb40 0x7fe9100a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d0e60 con 0x7fe9101f9570 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100d0ce0 con 0x7fe9100ceb40 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.501+0000 7fe9187c6640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100d0fe0 con 0x7fe91006f4b0 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48466/0 (socket says 172.21.15.63:48466) 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 -- 172.21.15.63:0/2080591667 learned_addr learned my addr 172.21.15.63:0/2080591667 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916562640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe91006f4b0 0x7fe9100c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe915d61640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100ceb40 0x7fe9100a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 -- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe91006f4b0 msgr2=0x7fe9100c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe91006f4b0 0x7fe9100c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 -- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100ceb40 msgr2=0x7fe9100a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100ceb40 0x7fe9100a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 -- 172.21.15.63:0/2080591667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100a2420 con 0x7fe9101f9570 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe916d63640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe908006010 tx=0x7fe908003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:25.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90803e030 con 0x7fe9101f9570 2024-09-17T04:23:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe908003d70 con 0x7fe9101f9570 2024-09-17T04:23:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9100c99c0 con 0x7fe9101f9570 2024-09-17T04:23:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908035040 con 0x7fe9101f9570 2024-09-17T04:23:25.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.502+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9100c9f80 con 0x7fe9101f9570 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.503+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100d1510 con 0x7fe9101f9570 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.504+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe908041030 con 0x7fe9101f9570 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.505+0000 7fe90effd640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 0x7fe8fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.505+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9080bb450 con 0x7fe9101f9570 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.505+0000 7fe916562640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 0x7fe8fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.505+0000 7fe916562640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 0x7fe8fc07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe9000097d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:25.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.509+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9100a2420 con 0x7fe9101f9570 2024-09-17T04:23:25.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.694+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9100cf900 con 0x7fe9101f9570 2024-09-17T04:23:25.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.695+0000 7fe90effd640 1 -- 172.21.15.63:0/2080591667 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16654 (secure 0 0 0) 0x7fe908083920 con 0x7fe9101f9570 2024-09-17T04:23:25.695 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:25.695 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":20,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:24.713230+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 msgr2=0x7fe8fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 0x7fe8fc07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe9000097d0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 msgr2=0x7fe9101f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe908006010 tx=0x7fe908003880 comp rx=0 tx=0).stop 2024-09-17T04:23:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 shutdown_connections 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe8fc078b90 0x7fe8fc07b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe9100ceb40 0x7fe9100a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9101f9570 0x7fe9101f89b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 --2- 172.21.15.63:0/2080591667 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe91006f4b0 0x7fe9100c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 >> 172.21.15.63:0/2080591667 conn(0x7fe91008bfc0 msgr2=0x7fe910068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 shutdown_connections 2024-09-17T04:23:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.697+0000 7fe9187c6640 1 -- 172.21.15.63:0/2080591667 wait complete. 2024-09-17T04:23:25.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 -- 172.21.15.63:0/3309076375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0b9b60 msgr2=0x7fa50c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 --2- 172.21.15.63:0/3309076375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0b9b60 0x7fa50c0d0fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0d0910 tx=0x7fa50802aa30 comp rx=0 tx=0).stop 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 -- 172.21.15.63:0/3309076375 shutdown_connections 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 --2- 172.21.15.63:0/3309076375 >> v2:172.21.15.112:3300/0 conn(0x7fa50c0d14f0 0x7fa50c162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 --2- 172.21.15.63:0/3309076375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0b9b60 0x7fa50c0d0fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 -- 172.21.15.63:0/3309076375 >> 172.21.15.63:0/3309076375 conn(0x7fa50c09d8f0 msgr2=0x7fa50c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:25.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 -- 172.21.15.63:0/3309076375 shutdown_connections 2024-09-17T04:23:25.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.825+0000 7fa513d6e640 1 -- 172.21.15.63:0/3309076375 wait complete. 2024-09-17T04:23:25.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.827+0000 7fa513d6e640 1 Processor -- start 2024-09-17T04:23:25.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.827+0000 7fa513d6e640 1 -- start start 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0b3a10 0x7fa50c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa50c0b9b60 0x7fa50c15e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0d03d0 con 0x7fa50c0d14f0 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c0d1fa0 con 0x7fa50c0b3a10 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa513d6e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa50c163080 con 0x7fa50c0b9b60 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa51230b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa51230b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48488/0 (socket says 172.21.15.63:48488) 2024-09-17T04:23:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa51230b640 1 -- 172.21.15.63:0/647291215 learned_addr learned my addr 172.21.15.63:0/647291215 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa511b0a640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0b3a10 0x7fa50c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.828+0000 7fa511309640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa50c0b9b60 0x7fa50c15e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 -- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa50c0b9b60 msgr2=0x7fa50c15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa50c0b9b60 0x7fa50c15e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 -- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0b3a10 msgr2=0x7fa50c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0b3a10 0x7fa50c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 -- 172.21.15.63:0/647291215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c1572c0 con 0x7fa50c0d14f0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa51230b640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e6d0 tx=0x7fa50400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50400cab0 con 0x7fa50c0d14f0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa50400cc50 con 0x7fa50c0d14f0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c0c8270 con 0x7fa50c0d14f0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504005020 con 0x7fa50c0d14f0 2024-09-17T04:23:25.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.829+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c0c9ce0 con 0x7fa50c0d14f0 2024-09-17T04:23:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.830+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50c0c9f40 con 0x7fa50c0d14f0 2024-09-17T04:23:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.831+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa5040051e0 con 0x7fa50c0d14f0 2024-09-17T04:23:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.831+0000 7fa5027fc640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 0x7fa4f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:25.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.831+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa50409b480 con 0x7fa50c0d14f0 2024-09-17T04:23:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.832+0000 7fa511b0a640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 0x7fa4f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:25.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.832+0000 7fa511b0a640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 0x7fa4f007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa508035000 tx=0x7fa50803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:25.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:25.836+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa504063300 con 0x7fa50c0d14f0 2024-09-17T04:23:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.021+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa50c1574e0 con 0x7fa50c0d14f0 2024-09-17T04:23:26.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.022+0000 7fa5027fc640 1 -- 172.21.15.63:0/647291215 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16654 (secure 0 0 0) 0x7fa504067d30 con 0x7fa50c0d14f0 2024-09-17T04:23:26.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:26.022 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":20,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:24.713230+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 msgr2=0x7fa4f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 0x7fa4f007b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa508035000 tx=0x7fa50803b040 comp rx=0 tx=0).stop 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 msgr2=0x7fa50c15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa50400e6d0 tx=0x7fa50400eb90 comp rx=0 tx=0).stop 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 shutdown_connections 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa4f0078b90 0x7fa4f007b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa50c0d14f0 0x7fa50c15cab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa50c0b9b60 0x7fa50c15e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 --2- 172.21.15.63:0/647291215 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa50c0b3a10 0x7fa50c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 >> 172.21.15.63:0/647291215 conn(0x7fa50c09d8f0 msgr2=0x7fa50c168be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:26.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 shutdown_connections 2024-09-17T04:23:26.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.024+0000 7fa513d6e640 1 -- 172.21.15.63:0/647291215 wait complete. 2024-09-17T04:23:26.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T04:23:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 -- 172.21.15.63:0/829456709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9015c580 msgr2=0x7f1b90070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/829456709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9015c580 0x7f1b90070370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1b80005fd0 tx=0x7f1b8002a8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 -- 172.21.15.63:0/829456709 shutdown_connections 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/829456709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9015c580 0x7f1b90070370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/829456709 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b90074420 0x7f1b9006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 -- 172.21.15.63:0/829456709 >> 172.21.15.63:0/829456709 conn(0x7f1b9006def0 msgr2=0x7f1b9006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 -- 172.21.15.63:0/829456709 shutdown_connections 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.154+0000 7f1b96ba1640 1 -- 172.21.15.63:0/829456709 wait complete. 2024-09-17T04:23:26.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.156+0000 7f1b96ba1640 1 Processor -- start 2024-09-17T04:23:26.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.156+0000 7f1b96ba1640 1 -- start start 2024-09-17T04:23:26.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 0x7f1b90144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b900cc880 0x7f1b900d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9015f850 con 0x7f1b90074420 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b90070ba0 con 0x7f1b90155ce0 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.157+0000 7f1b96ba1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9015f9d0 con 0x7f1b900cc880 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48508/0 (socket says 172.21.15.63:48508) 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 -- 172.21.15.63:0/108080751 learned_addr learned my addr 172.21.15.63:0/108080751 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9513e640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b900cc880 0x7f1b900d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b8ffff640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 0x7f1b90144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 -- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b900cc880 msgr2=0x7f1b900d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b900cc880 0x7f1b900d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 -- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 msgr2=0x7f1b90144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 0x7f1b90144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 -- 172.21.15.63:0/108080751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b900c74b0 con 0x7f1b90074420 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b8ffff640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 0x7f1b90144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b9493d640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800e790 tx=0x7f1b8800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800eea0 con 0x7f1b90074420 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b8800cdb0 con 0x7f1b90074420 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b900c7790 con 0x7f1b90074420 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88010690 con 0x7f1b90074420 2024-09-17T04:23:26.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.158+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b900c7d50 con 0x7f1b90074420 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.159+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9015ff10 con 0x7f1b90074420 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.160+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b88010830 con 0x7f1b90074420 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.160+0000 7f1b8d7fa640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.161+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8809b600 con 0x7f1b90074420 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.161+0000 7f1b8ffff640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:26.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.161+0000 7f1b8ffff640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 0x7f1b7007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b80004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:26.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.165+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b88063480 con 0x7f1b90074420 2024-09-17T04:23:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:26.391+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1b9015ae10 con 0x7f1b90074420 2024-09-17T04:23:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.380+0000 7f1b8d7fa640 1 -- 172.21.15.63:0/108080751 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f1b88067eb0 con 0x7f1b90074420 2024-09-17T04:23:27.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.383+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 msgr2=0x7f1b7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:27.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.383+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 0x7f1b7007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b80034000 tx=0x7f1b80004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.383+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 msgr2=0x7f1b90144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.383+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800e790 tx=0x7f1b8800ec50 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 shutdown_connections 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b90155ce0 0x7f1b90144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b900cc880 0x7f1b900d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 --2- 172.21.15.63:0/108080751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b90074420 0x7f1b90144d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 >> 172.21.15.63:0/108080751 conn(0x7f1b9006def0 msgr2=0x7f1b9015e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 shutdown_connections 2024-09-17T04:23:27.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.384+0000 7f1b96ba1640 1 -- 172.21.15.63:0/108080751 wait complete. 2024-09-17T04:23:27.397 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T04:23:27.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T04:23:27.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1282611354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6100 msgr2=0x7fb3b80b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1282611354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6100 0x7fb3b80b14f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8074f60 tx=0x7fb3a402a4b0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1282611354 shutdown_connections 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1282611354 >> v2:172.21.15.112:3300/0 conn(0x7fb3b8162f60 0x7fb3b8165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1282611354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6100 0x7fb3b80b14f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.524+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1282611354 >> 172.21.15.63:0/1282611354 conn(0x7fb3b80d12a0 msgr2=0x7fb3b80d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.525+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1282611354 shutdown_connections 2024-09-17T04:23:27.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.525+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1282611354 wait complete. 2024-09-17T04:23:27.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.526+0000 7fb3bec9b640 1 Processor -- start 2024-09-17T04:23:27.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.526+0000 7fb3bec9b640 1 -- start start 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 0x7fb3b8161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 0x7fb3b815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8165a40 con 0x7fb3b80b6680 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81658c0 con 0x7fb3b8162f60 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bec9b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b8165bc0 con 0x7fb3b80b6100 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48540/0 (socket says 172.21.15.63:48540) 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 -- 172.21.15.63:0/1791268936 learned_addr learned my addr 172.21.15.63:0/1791268936 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bca37640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 0x7fb3b8161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bd238640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 0x7fb3b815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 -- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 msgr2=0x7fb3b8161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 0x7fb3b8161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 -- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 msgr2=0x7fb3b815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 0x7fb3b815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 -- 172.21.15.63:0/1791268936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b8159d70 con 0x7fb3b80b6680 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bca37640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 0x7fb3b8161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3bd238640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 0x7fb3b815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.528+0000 7fb3b7fff640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4034040 tx=0x7fb3a40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.529+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a403e030 con 0x7fb3b80b6680 2024-09-17T04:23:27.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.529+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a40047a0 con 0x7fb3b80b6680 2024-09-17T04:23:27.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.529+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b81625f0 con 0x7fb3b80b6680 2024-09-17T04:23:27.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.529+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4035040 con 0x7fb3b80b6680 2024-09-17T04:23:27.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.529+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b81f5de0 con 0x7fb3b80b6680 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.530+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b8162360 con 0x7fb3b80b6680 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.530+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3a4041030 con 0x7fb3b80b6680 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.531+0000 7fb3b57fa640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 0x7fb39c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.531+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb3a40bb600 con 0x7fb3b80b6680 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.531+0000 7fb3bca37640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 0x7fb39c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:27.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.532+0000 7fb3bca37640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 0x7fb39c07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80ceda0 tx=0x7fb3ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:27.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.536+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3b8159d70 con 0x7fb3b80b6680 2024-09-17T04:23:27.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:27.759+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb3b80b0de0 con 0x7fb3b80b6680 2024-09-17T04:23:28.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.382+0000 7fb3b57fa640 1 -- 172.21.15.63:0/1791268936 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb3a4083a40 con 0x7fb3b80b6680 2024-09-17T04:23:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 msgr2=0x7fb39c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 0x7fb39c07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80ceda0 tx=0x7fb3ac008040 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 msgr2=0x7fb3b8159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4034040 tx=0x7fb3a40039e0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 shutdown_connections 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb39c078bc0 0x7fb39c07b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb3b8162f60 0x7fb3b815b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3b80b6680 0x7fb3b8159830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 --2- 172.21.15.63:0/1791268936 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb3b80b6100 0x7fb3b8161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.384+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 >> 172.21.15.63:0/1791268936 conn(0x7fb3b80d12a0 msgr2=0x7fb3b8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.385+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 shutdown_connections 2024-09-17T04:23:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.385+0000 7fb3bec9b640 1 -- 172.21.15.63:0/1791268936 wait complete. 2024-09-17T04:23:28.397 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T04:23:28.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 -- 172.21.15.63:0/2611882774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3840053a0 msgr2=0x7fa38400ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 --2- 172.21.15.63:0/2611882774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3840053a0 0x7fa38400ba50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa388001690 tx=0x7fa384005830 comp rx=0 tx=0).stop 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 -- 172.21.15.63:0/2611882774 shutdown_connections 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 --2- 172.21.15.63:0/2611882774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3840053a0 0x7fa38400ba50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 -- 172.21.15.63:0/2611882774 >> 172.21.15.63:0/2611882774 conn(0x7fa39809d840 msgr2=0x7fa39808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 -- 172.21.15.63:0/2611882774 shutdown_connections 2024-09-17T04:23:28.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.516+0000 7fa39d415640 1 -- 172.21.15.63:0/2611882774 wait complete. 2024-09-17T04:23:28.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.518+0000 7fa39d415640 1 Processor -- start 2024-09-17T04:23:28.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.518+0000 7fa39d415640 1 -- start start 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3840053a0 0x7fa398154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3981f9bc0 0x7fa3980ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa39806fb20 con 0x7fa3981f9fd0 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa39806f9a0 con 0x7fa3981f9bc0 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa39d415640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa39806e610 con 0x7fa3840053a0 2024-09-17T04:23:28.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48558/0 (socket says 172.21.15.63:48558) 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 -- 172.21.15.63:0/1491835208 learned_addr learned my addr 172.21.15.63:0/1491835208 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3967fc640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3981f9bc0 0x7fa3980ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa396ffd640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3840053a0 0x7fa398154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 -- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3840053a0 msgr2=0x7fa398154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3840053a0 0x7fa398154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 -- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3981f9bc0 msgr2=0x7fa3980ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3981f9bc0 0x7fa3980ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.519+0000 7fa3977fe640 1 -- 172.21.15.63:0/1491835208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa398154c40 con 0x7fa3981f9fd0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa3977fe640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3880017b0 tx=0x7fa3880062e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388003a00 con 0x7fa3981f9fd0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa388003ba0 con 0x7fa3981f9fd0 2024-09-17T04:23:28.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3980ccce0 con 0x7fa3981f9fd0 2024-09-17T04:23:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3880064d0 con 0x7fa3981f9fd0 2024-09-17T04:23:28.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.520+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3980cd2a0 con 0x7fa3981f9fd0 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.521+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa39806ea50 con 0x7fa3981f9fd0 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.522+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa388030020 con 0x7fa3981f9fd0 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.522+0000 7fa38f7fe640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 0x7fa37807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.522+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa3880ba100 con 0x7fa3981f9fd0 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.522+0000 7fa396ffd640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 0x7fa37807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.523+0000 7fa396ffd640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 0x7fa37807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa390006fd0 tx=0x7fa390006a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.527+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa388081f80 con 0x7fa3981f9fd0 2024-09-17T04:23:28.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.750+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3980b3830 con 0x7fa3981f9fd0 2024-09-17T04:23:28.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.751+0000 7fa38f7fe640 1 -- 172.21.15.63:0/1491835208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fa3880869b0 con 0x7fa3981f9fd0 2024-09-17T04:23:28.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:28.751 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:28.751 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:28.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 msgr2=0x7fa37807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 0x7fa37807b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa390006fd0 tx=0x7fa390006a70 comp rx=0 tx=0).stop 2024-09-17T04:23:28.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 msgr2=0x7fa3980ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3880017b0 tx=0x7fa3880062e0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 shutdown_connections 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa378078b90 0x7fa37807b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa3981f9bc0 0x7fa3980ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3981f9fd0 0x7fa3980ca7c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 --2- 172.21.15.63:0/1491835208 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa3840053a0 0x7fa398154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 >> 172.21.15.63:0/1491835208 conn(0x7fa39809d840 msgr2=0x7fa398068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 shutdown_connections 2024-09-17T04:23:28.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.753+0000 7fa39d415640 1 -- 172.21.15.63:0/1491835208 wait complete. 2024-09-17T04:23:28.764 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 -- 172.21.15.63:0/3444813306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880ceb40 msgr2=0x7f26880cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 --2- 172.21.15.63:0/3444813306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880ceb40 0x7f26880cef50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2680005fd0 tx=0x7f268002a840 comp rx=0 tx=0).stop 2024-09-17T04:23:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 -- 172.21.15.63:0/3444813306 shutdown_connections 2024-09-17T04:23:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 --2- 172.21.15.63:0/3444813306 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880ceb40 0x7f26880cef50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 -- 172.21.15.63:0/3444813306 >> 172.21.15.63:0/3444813306 conn(0x7f268808bfc0 msgr2=0x7f268809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 -- 172.21.15.63:0/3444813306 shutdown_connections 2024-09-17T04:23:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.881+0000 7f268ea9b640 1 -- 172.21.15.63:0/3444813306 wait complete. 2024-09-17T04:23:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.883+0000 7f268ea9b640 1 Processor -- start 2024-09-17T04:23:28.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.883+0000 7f268ea9b640 1 -- start start 2024-09-17T04:23:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880b3540 0x7f26880a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26880ca1c0 0x7f26880ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f26880d1070 con 0x7f26880ceb40 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f26880d0ef0 con 0x7f26880b3540 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f268ea9b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f26880d11f0 con 0x7f26880ca1c0 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f2687fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.884+0000 7f2687fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48562/0 (socket says 172.21.15.63:48562) 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 -- 172.21.15.63:0/1010728095 learned_addr learned my addr 172.21.15.63:0/1010728095 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f268c837640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880b3540 0x7f26880a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f268d038640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26880ca1c0 0x7f26880ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 -- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26880ca1c0 msgr2=0x7f26880ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26880ca1c0 0x7f26880ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 -- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880b3540 msgr2=0x7f26880a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880b3540 0x7f26880a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 -- 172.21.15.63:0/1010728095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26880cab10 con 0x7f26880ceb40 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f2687fff640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c450 tx=0x7f267c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c016020 con 0x7f26880ceb40 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f267c012920 con 0x7f26880ceb40 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c012d30 con 0x7f26880ceb40 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26880a1960 con 0x7f26880ceb40 2024-09-17T04:23:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.885+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26880a1f20 con 0x7f26880ceb40 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.886+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f268806e170 con 0x7f26880ceb40 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.887+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f267c019020 con 0x7f26880ceb40 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.888+0000 7f26857fa640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 0x7f267407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.888+0000 7f268c837640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 0x7f267407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.888+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f267c09ac20 con 0x7f26880ceb40 2024-09-17T04:23:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.888+0000 7f268c837640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 0x7f267407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:28.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:28.893+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f267c020020 con 0x7f26880ceb40 2024-09-17T04:23:29.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.080+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26880a16f0 con 0x7f26880ceb40 2024-09-17T04:23:29.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.081+0000 7f26857fa640 1 -- 172.21.15.63:0/1010728095 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f26880cab10 con 0x7f26880ceb40 2024-09-17T04:23:29.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:29.081 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 msgr2=0x7f267407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 0x7f267407b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2678000f60 tx=0x7f2678009040 comp rx=0 tx=0).stop 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 msgr2=0x7f2688158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f267c00c450 tx=0x7f267c00c910 comp rx=0 tx=0).stop 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 shutdown_connections 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2674078b90 0x7f267407b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f26880ca1c0 0x7f26880ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26880ceb40 0x7f2688158230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 --2- 172.21.15.63:0/1010728095 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f26880b3540 0x7f26880a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 >> 172.21.15.63:0/1010728095 conn(0x7f268808bfc0 msgr2=0x7f26880d3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 shutdown_connections 2024-09-17T04:23:29.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.083+0000 7f268ea9b640 1 -- 172.21.15.63:0/1010728095 wait complete. 2024-09-17T04:23:29.094 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:23:29.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:29.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.210+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2269156222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d4a50 msgr2=0x7f1e880b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.210+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2269156222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d4a50 0x7f1e880b4040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e80005fd0 tx=0x7f1e8002a8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2269156222 shutdown_connections 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2269156222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d4a50 0x7f1e880b4040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2269156222 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880d4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2269156222 >> 172.21.15.63:0/2269156222 conn(0x7f1e8808bfc0 msgr2=0x7f1e8809d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2269156222 shutdown_connections 2024-09-17T04:23:29.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.211+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2269156222 wait complete. 2024-09-17T04:23:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.213+0000 7f1e8d18b640 1 Processor -- start 2024-09-17T04:23:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.213+0000 7f1e8d18b640 1 -- start start 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 0x7f1e880b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e880b4b00 con 0x7f1e880d0ce0 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1e880b4980 con 0x7f1e880d4a50 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8d18b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1e880b4c80 con 0x7f1e880b9be0 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48592/0 (socket says 172.21.15.63:48592) 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 -- 172.21.15.63:0/2561590741 learned_addr learned my addr 172.21.15.63:0/2561590741 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8759e640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 0x7f1e880b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e86d9d640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 -- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 msgr2=0x7f1e880cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 -- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 msgr2=0x7f1e880b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 0x7f1e880b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8659c640 1 -- 172.21.15.63:0/2561590741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e880cc280 con 0x7f1e880d0ce0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e86d9d640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.214+0000 7f1e8759e640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 0x7f1e880b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e8659c640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00d6d0 tx=0x7f1e7c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c017070 con 0x7f1e880d0ce0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e7c009b10 con 0x7f1e880d0ce0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e881f8e20 con 0x7f1e880d0ce0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c010460 con 0x7f1e880d0ce0 2024-09-17T04:23:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.215+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e881f63c0 con 0x7f1e880d0ce0 2024-09-17T04:23:29.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.216+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e880cbff0 con 0x7f1e880d0ce0 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.216+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e7c01a070 con 0x7f1e880d0ce0 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.217+0000 7f1e6f7fe640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 0x7f1e7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.217+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e7c09ae10 con 0x7f1e880d0ce0 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.217+0000 7f1e86d9d640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 0x7f1e7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.218+0000 7f1e86d9d640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 0x7f1e7407b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e78000f60 tx=0x7f1e78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.222+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e7c0632e0 con 0x7f1e880d0ce0 2024-09-17T04:23:29.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.406+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e880b51a0 con 0x7f1e74078b90 2024-09-17T04:23:29.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.410+0000 7f1e6f7fe640 1 -- 172.21.15.63:0/2561590741 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243499 (secure 0 0 0) 0x7f1e880b51a0 con 0x7f1e74078b90 2024-09-17T04:23:29.413 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:29.414 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:29.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 msgr2=0x7f1e7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 0x7f1e7407b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e78000f60 tx=0x7f1e78009040 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 msgr2=0x7f1e8815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00d6d0 tx=0x7f1e7c00db90 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 shutdown_connections 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1e74078b90 0x7f1e7407b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1e880d4a50 0x7f1e880b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e880d0ce0 0x7f1e8815eac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 --2- 172.21.15.63:0/2561590741 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1e880b9be0 0x7f1e880cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 >> 172.21.15.63:0/2561590741 conn(0x7f1e8808bfc0 msgr2=0x7f1e88068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 shutdown_connections 2024-09-17T04:23:29.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.414+0000 7f1e8d18b640 1 -- 172.21.15.63:0/2561590741 wait complete. 2024-09-17T04:23:29.425 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T04:23:28.399165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2613248,"data_stored":1628928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071724"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337819+0000","last_change":"2024-09-17T04:23:23.337819+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337819+0000","last_undegraded":"2024-09-17T04:23:23.337819+0000","last_fullsized":"2024-09-17T04:23:23.337819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334047+0000","last_change":"2024-09-17T04:23:23.334047+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334047+0000","last_undegraded":"2024-09-17T04:23:23.334047+0000","last_fullsized":"2024-09-17T04:23:23.334047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337495+0000","last_change":"2024-09-17T04:23:23.337495+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337495+0000","last_undegraded":"2024-09-17T04:23:23.337495+0000","last_fullsized":"2024-09-17T04:23:23.337495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.335100+0000","last_change":"2024-09-17T04:23:23.335100+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.335100+0000","last_undegraded":"2024-09-17T04:23:23.335100+0000","last_fullsized":"2024-09-17T04:23:23.335100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333800+0000","last_change":"2024-09-17T04:23:23.333800+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333800+0000","last_undegraded":"2024-09-17T04:23:23.333800+0000","last_fullsized":"2024-09-17T04:23:23.333800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336152+0000","last_change":"2024-09-17T04:23:23.336152+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336152+0000","last_undegraded":"2024-09-17T04:23:23.336152+0000","last_fullsized":"2024-09-17T04:23:23.336152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333766+0000","last_change":"2024-09-17T04:23:23.333766+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333766+0000","last_undegraded":"2024-09-17T04:23:23.333766+0000","last_fullsized":"2024-09-17T04:23:23.333766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334229+0000","last_change":"2024-09-17T04:23:23.334229+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334229+0000","last_undegraded":"2024-09-17T04:23:23.334229+0000","last_fullsized":"2024-09-17T04:23:23.334229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.332605+0000","last_change":"2024-09-17T04:23:23.332605+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.332605+0000","last_undegraded":"2024-09-17T04:23:23.332605+0000","last_fullsized":"2024-09-17T04:23:23.332605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333262+0000","last_change":"2024-09-17T04:23:23.333262+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333262+0000","last_undegraded":"2024-09-17T04:23:23.333262+0000","last_fullsized":"2024-09-17T04:23:23.333262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333323+0000","last_change":"2024-09-17T04:23:23.333323+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333323+0000","last_undegraded":"2024-09-17T04:23:23.333323+0000","last_fullsized":"2024-09-17T04:23:23.333323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T04:23:23.339910+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:23.339910+0000","last_peered":"2024-09-17T04:23:23.339910+0000","last_clean":"2024-09-17T04:23:23.339910+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:23.339910+0000","last_undegraded":"2024-09-17T04:23:23.339910+0000","last_fullsized":"2024-09-17T04:23:23.339910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338477+0000","last_change":"2024-09-17T04:23:23.338477+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338477+0000","last_undegraded":"2024-09-17T04:23:23.338477+0000","last_fullsized":"2024-09-17T04:23:23.338477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333298+0000","last_change":"2024-09-17T04:23:23.333298+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333298+0000","last_undegraded":"2024-09-17T04:23:23.333298+0000","last_fullsized":"2024-09-17T04:23:23.333298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338740+0000","last_change":"2024-09-17T04:23:23.338740+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338740+0000","last_undegraded":"2024-09-17T04:23:23.338740+0000","last_fullsized":"2024-09-17T04:23:23.338740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356924+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:26.356924+0000","last_peered":"2024-09-17T04:23:26.356924+0000","last_clean":"2024-09-17T04:23:26.356924+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:26.356924+0000","last_undegraded":"2024-09-17T04:23:26.356924+0000","last_fullsized":"2024-09-17T04:23:26.356924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333973+0000","last_change":"2024-09-17T04:23:23.333973+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333973+0000","last_undegraded":"2024-09-17T04:23:23.333973+0000","last_fullsized":"2024-09-17T04:23:23.333973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339185+0000","last_change":"2024-09-17T04:23:23.339185+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339185+0000","last_undegraded":"2024-09-17T04:23:23.339185+0000","last_fullsized":"2024-09-17T04:23:23.339185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338532+0000","last_change":"2024-09-17T04:23:23.338532+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338532+0000","last_undegraded":"2024-09-17T04:23:23.338532+0000","last_fullsized":"2024-09-17T04:23:23.338532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338741+0000","last_change":"2024-09-17T04:23:23.338741+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338741+0000","last_undegraded":"2024-09-17T04:23:23.338741+0000","last_fullsized":"2024-09-17T04:23:23.338741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339480+0000","last_change":"2024-09-17T04:23:23.339480+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339480+0000","last_undegraded":"2024-09-17T04:23:23.339480+0000","last_fullsized":"2024-09-17T04:23:23.339480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337938+0000","last_change":"2024-09-17T04:23:23.337938+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337938+0000","last_undegraded":"2024-09-17T04:23:23.337938+0000","last_fullsized":"2024-09-17T04:23:23.337938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336994+0000","last_change":"2024-09-17T04:23:23.336994+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336994+0000","last_undegraded":"2024-09-17T04:23:23.336994+0000","last_fullsized":"2024-09-17T04:23:23.336994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:29.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/2893034624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 msgr2=0x7fd8ac0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/2893034624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0d1260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4005fd0 tx=0x7fd8a402a980 comp rx=0 tx=0).stop 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/2893034624 shutdown_connections 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/2893034624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0d1260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/2893034624 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 0x7fd8ac0b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/2893034624 >> 172.21.15.63:0/2893034624 conn(0x7fd8ac09d840 msgr2=0x7fd8ac08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/2893034624 shutdown_connections 2024-09-17T04:23:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.581+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/2893034624 wait complete. 2024-09-17T04:23:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.583+0000 7fd8b2c0e640 1 Processor -- start 2024-09-17T04:23:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.583+0000 7fd8b2c0e640 1 -- start start 2024-09-17T04:23:29.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 0x7fd8ac1f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ac06f6e0 0x7fd8ac0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac0cfea0 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac0cfd20 con 0x7fd8ac06f6e0 2024-09-17T04:23:29.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b2c0e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac0d0020 con 0x7fd8ac06e0a0 2024-09-17T04:23:29.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b11ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b11ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48612/0 (socket says 172.21.15.63:48612) 2024-09-17T04:23:29.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b11ab640 1 -- 172.21.15.63:0/309375579 learned_addr learned my addr 172.21.15.63:0/309375579 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:29.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8b09aa640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 0x7fd8ac1f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.584+0000 7fd8abfff640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ac06f6e0 0x7fd8ac0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 -- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 msgr2=0x7fd8ac1f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 0x7fd8ac1f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 -- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ac06f6e0 msgr2=0x7fd8ac0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ac06f6e0 0x7fd8ac0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 -- 172.21.15.63:0/309375579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac1f9cf0 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b11ab640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4033040 tx=0x7fd8a4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4034040 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a4004540 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ac1f5950 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4045480 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.585+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ac1f5ed0 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.586+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ac0d0490 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.587+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8a4037020 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.588+0000 7fd8a97fa640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 0x7fd89807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.588+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8a40bc510 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.588+0000 7fd8b09aa640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 0x7fd89807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.589+0000 7fd8b09aa640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 0x7fd89807b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bb30 tx=0x7fd89c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.592+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8ac1f9cf0 con 0x7fd8ac0d0e50 2024-09-17T04:23:29.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.772+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8ac06e860 con 0x7fd898078bc0 2024-09-17T04:23:29.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.777+0000 7fd8a97fa640 1 -- 172.21.15.63:0/309375579 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243499 (secure 0 0 0) 0x7fd8ac06e860 con 0x7fd898078bc0 2024-09-17T04:23:29.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:29.780 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 msgr2=0x7fd89807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 0x7fd89807b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bb30 tx=0x7fd89c00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 msgr2=0x7fd8ac0b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4033040 tx=0x7fd8a4003f10 comp rx=0 tx=0).stop 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 shutdown_connections 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd898078bc0 0x7fd89807b0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd8ac06f6e0 0x7fd8ac0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8ac0d0e50 0x7fd8ac0b2c30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 --2- 172.21.15.63:0/309375579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd8ac06e0a0 0x7fd8ac1f97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 >> 172.21.15.63:0/309375579 conn(0x7fd8ac09d840 msgr2=0x7fd8ac0ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 shutdown_connections 2024-09-17T04:23:29.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.780+0000 7fd8b2c0e640 1 -- 172.21.15.63:0/309375579 wait complete. 2024-09-17T04:23:29.791 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T04:23:28.399165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2613248,"data_stored":1628928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071724"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337819+0000","last_change":"2024-09-17T04:23:23.337819+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337819+0000","last_undegraded":"2024-09-17T04:23:23.337819+0000","last_fullsized":"2024-09-17T04:23:23.337819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334047+0000","last_change":"2024-09-17T04:23:23.334047+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334047+0000","last_undegraded":"2024-09-17T04:23:23.334047+0000","last_fullsized":"2024-09-17T04:23:23.334047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337495+0000","last_change":"2024-09-17T04:23:23.337495+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337495+0000","last_undegraded":"2024-09-17T04:23:23.337495+0000","last_fullsized":"2024-09-17T04:23:23.337495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.335100+0000","last_change":"2024-09-17T04:23:23.335100+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.335100+0000","last_undegraded":"2024-09-17T04:23:23.335100+0000","last_fullsized":"2024-09-17T04:23:23.335100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333800+0000","last_change":"2024-09-17T04:23:23.333800+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333800+0000","last_undegraded":"2024-09-17T04:23:23.333800+0000","last_fullsized":"2024-09-17T04:23:23.333800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336152+0000","last_change":"2024-09-17T04:23:23.336152+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336152+0000","last_undegraded":"2024-09-17T04:23:23.336152+0000","last_fullsized":"2024-09-17T04:23:23.336152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333766+0000","last_change":"2024-09-17T04:23:23.333766+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333766+0000","last_undegraded":"2024-09-17T04:23:23.333766+0000","last_fullsized":"2024-09-17T04:23:23.333766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334229+0000","last_change":"2024-09-17T04:23:23.334229+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334229+0000","last_undegraded":"2024-09-17T04:23:23.334229+0000","last_fullsized":"2024-09-17T04:23:23.334229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.332605+0000","last_change":"2024-09-17T04:23:23.332605+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.332605+0000","last_undegraded":"2024-09-17T04:23:23.332605+0000","last_fullsized":"2024-09-17T04:23:23.332605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333262+0000","last_change":"2024-09-17T04:23:23.333262+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333262+0000","last_undegraded":"2024-09-17T04:23:23.333262+0000","last_fullsized":"2024-09-17T04:23:23.333262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333323+0000","last_change":"2024-09-17T04:23:23.333323+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333323+0000","last_undegraded":"2024-09-17T04:23:23.333323+0000","last_fullsized":"2024-09-17T04:23:23.333323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T04:23:23.339910+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:23.339910+0000","last_peered":"2024-09-17T04:23:23.339910+0000","last_clean":"2024-09-17T04:23:23.339910+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:23.339910+0000","last_undegraded":"2024-09-17T04:23:23.339910+0000","last_fullsized":"2024-09-17T04:23:23.339910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338477+0000","last_change":"2024-09-17T04:23:23.338477+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338477+0000","last_undegraded":"2024-09-17T04:23:23.338477+0000","last_fullsized":"2024-09-17T04:23:23.338477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333298+0000","last_change":"2024-09-17T04:23:23.333298+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333298+0000","last_undegraded":"2024-09-17T04:23:23.333298+0000","last_fullsized":"2024-09-17T04:23:23.333298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338740+0000","last_change":"2024-09-17T04:23:23.338740+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338740+0000","last_undegraded":"2024-09-17T04:23:23.338740+0000","last_fullsized":"2024-09-17T04:23:23.338740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356924+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:26.356924+0000","last_peered":"2024-09-17T04:23:26.356924+0000","last_clean":"2024-09-17T04:23:26.356924+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:26.356924+0000","last_undegraded":"2024-09-17T04:23:26.356924+0000","last_fullsized":"2024-09-17T04:23:26.356924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333973+0000","last_change":"2024-09-17T04:23:23.333973+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333973+0000","last_undegraded":"2024-09-17T04:23:23.333973+0000","last_fullsized":"2024-09-17T04:23:23.333973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339185+0000","last_change":"2024-09-17T04:23:23.339185+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339185+0000","last_undegraded":"2024-09-17T04:23:23.339185+0000","last_fullsized":"2024-09-17T04:23:23.339185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338532+0000","last_change":"2024-09-17T04:23:23.338532+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338532+0000","last_undegraded":"2024-09-17T04:23:23.338532+0000","last_fullsized":"2024-09-17T04:23:23.338532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338741+0000","last_change":"2024-09-17T04:23:23.338741+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338741+0000","last_undegraded":"2024-09-17T04:23:23.338741+0000","last_fullsized":"2024-09-17T04:23:23.338741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339480+0000","last_change":"2024-09-17T04:23:23.339480+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339480+0000","last_undegraded":"2024-09-17T04:23:23.339480+0000","last_fullsized":"2024-09-17T04:23:23.339480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337938+0000","last_change":"2024-09-17T04:23:23.337938+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337938+0000","last_undegraded":"2024-09-17T04:23:23.337938+0000","last_fullsized":"2024-09-17T04:23:23.337938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336994+0000","last_change":"2024-09-17T04:23:23.336994+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336994+0000","last_undegraded":"2024-09-17T04:23:23.336994+0000","last_fullsized":"2024-09-17T04:23:23.336994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:29.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:29.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 -- 172.21.15.63:0/1255365231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b9b60 msgr2=0x7ff12c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 --2- 172.21.15.63:0/1255365231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b9b60 0x7ff12c0d0fb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff11c005fd0 tx=0x7ff11c02a820 comp rx=0 tx=0).stop 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 -- 172.21.15.63:0/1255365231 shutdown_connections 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 --2- 172.21.15.63:0/1255365231 >> v2:172.21.15.112:3300/0 conn(0x7ff12c0b3a10 0x7ff12c0d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 --2- 172.21.15.63:0/1255365231 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b9b60 0x7ff12c0d0fb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 -- 172.21.15.63:0/1255365231 >> 172.21.15.63:0/1255365231 conn(0x7ff12c09d8f0 msgr2=0x7ff12c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 -- 172.21.15.63:0/1255365231 shutdown_connections 2024-09-17T04:23:29.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.947+0000 7ff13475e640 1 -- 172.21.15.63:0/1255365231 wait complete. 2024-09-17T04:23:29.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.949+0000 7ff13475e640 1 Processor -- start 2024-09-17T04:23:29.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.949+0000 7ff13475e640 1 -- start start 2024-09-17T04:23:29.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b3a10 0x7ff12c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff12c162430 0x7ff12c0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c162f50 con 0x7ff12c0b9b60 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c0d1fa0 con 0x7ff12c162430 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff12c1630d0 con 0x7ff12c0b3a10 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48618/0 (socket says 172.21.15.63:48618) 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 -- 172.21.15.63:0/137805550 learned_addr learned my addr 172.21.15.63:0/137805550 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff1324fa640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b3a10 0x7ff12c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff132cfb640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff12c162430 0x7ff12c0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 -- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b3a10 msgr2=0x7ff12c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b3a10 0x7ff12c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 -- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff12c162430 msgr2=0x7ff12c0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff12c162430 0x7ff12c0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:29.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 -- 172.21.15.63:0/137805550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c159020 con 0x7ff12c0b9b60 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff131cf9640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e9f0 tx=0x7ff12000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12000ccc0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff120004020 con 0x7ff12c0b9b60 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c0ca3c0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12000ce60 con 0x7ff12c0b9b60 2024-09-17T04:23:29.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.951+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1595a0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.953+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c0b4dc0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.953+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1200035f0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.954+0000 7ff12affd640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 0x7ff11807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.954+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff12009b6a0 con 0x7ff12c0b9b60 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.954+0000 7ff1324fa640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 0x7ff11807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:29.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.954+0000 7ff1324fa640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 0x7ff11807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff11c034000 tx=0x7ff11c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:29.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:29.958+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff120063ae0 con 0x7ff12c0b9b60 2024-09-17T04:23:30.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.141+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff12c162840 con 0x7ff118078b90 2024-09-17T04:23:30.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.146+0000 7ff12affd640 1 -- 172.21.15.63:0/137805550 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243499 (secure 0 0 0) 0x7ff12c162840 con 0x7ff118078b90 2024-09-17T04:23:30.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:30.149 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:30.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.148+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 msgr2=0x7ff11807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.148+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 0x7ff11807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff11c034000 tx=0x7ff11c004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.148+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 msgr2=0x7ff12c0b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.148+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e9f0 tx=0x7ff12000eeb0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 shutdown_connections 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff118078b90 0x7ff11807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff12c162430 0x7ff12c0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff12c0b9b60 0x7ff12c0b5790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 --2- 172.21.15.63:0/137805550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff12c0b3a10 0x7ff12c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 >> 172.21.15.63:0/137805550 conn(0x7ff12c09d8f0 msgr2=0x7ff12c0b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 shutdown_connections 2024-09-17T04:23:30.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.149+0000 7ff13475e640 1 -- 172.21.15.63:0/137805550 wait complete. 2024-09-17T04:23:30.160 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T04:23:28.399165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219032,"kb_used_data":2552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2613248,"data_stored":1628928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071724"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337819+0000","last_change":"2024-09-17T04:23:23.337819+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337819+0000","last_undegraded":"2024-09-17T04:23:23.337819+0000","last_fullsized":"2024-09-17T04:23:23.337819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334047+0000","last_change":"2024-09-17T04:23:23.334047+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334047+0000","last_undegraded":"2024-09-17T04:23:23.334047+0000","last_fullsized":"2024-09-17T04:23:23.334047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337495+0000","last_change":"2024-09-17T04:23:23.337495+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337495+0000","last_undegraded":"2024-09-17T04:23:23.337495+0000","last_fullsized":"2024-09-17T04:23:23.337495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.335100+0000","last_change":"2024-09-17T04:23:23.335100+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.335100+0000","last_undegraded":"2024-09-17T04:23:23.335100+0000","last_fullsized":"2024-09-17T04:23:23.335100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333800+0000","last_change":"2024-09-17T04:23:23.333800+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333800+0000","last_undegraded":"2024-09-17T04:23:23.333800+0000","last_fullsized":"2024-09-17T04:23:23.333800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336152+0000","last_change":"2024-09-17T04:23:23.336152+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336152+0000","last_undegraded":"2024-09-17T04:23:23.336152+0000","last_fullsized":"2024-09-17T04:23:23.336152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333766+0000","last_change":"2024-09-17T04:23:23.333766+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333766+0000","last_undegraded":"2024-09-17T04:23:23.333766+0000","last_fullsized":"2024-09-17T04:23:23.333766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.334229+0000","last_change":"2024-09-17T04:23:23.334229+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.334229+0000","last_undegraded":"2024-09-17T04:23:23.334229+0000","last_fullsized":"2024-09-17T04:23:23.334229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.332605+0000","last_change":"2024-09-17T04:23:23.332605+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.332605+0000","last_undegraded":"2024-09-17T04:23:23.332605+0000","last_fullsized":"2024-09-17T04:23:23.332605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333262+0000","last_change":"2024-09-17T04:23:23.333262+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333262+0000","last_undegraded":"2024-09-17T04:23:23.333262+0000","last_fullsized":"2024-09-17T04:23:23.333262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333323+0000","last_change":"2024-09-17T04:23:23.333323+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333323+0000","last_undegraded":"2024-09-17T04:23:23.333323+0000","last_fullsized":"2024-09-17T04:23:23.333323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T04:23:23.339910+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:23.339910+0000","last_peered":"2024-09-17T04:23:23.339910+0000","last_clean":"2024-09-17T04:23:23.339910+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:23.339910+0000","last_undegraded":"2024-09-17T04:23:23.339910+0000","last_fullsized":"2024-09-17T04:23:23.339910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338477+0000","last_change":"2024-09-17T04:23:23.338477+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338477+0000","last_undegraded":"2024-09-17T04:23:23.338477+0000","last_fullsized":"2024-09-17T04:23:23.338477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333298+0000","last_change":"2024-09-17T04:23:23.333298+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333298+0000","last_undegraded":"2024-09-17T04:23:23.333298+0000","last_fullsized":"2024-09-17T04:23:23.333298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338740+0000","last_change":"2024-09-17T04:23:23.338740+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338740+0000","last_undegraded":"2024-09-17T04:23:23.338740+0000","last_fullsized":"2024-09-17T04:23:23.338740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356924+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:26.356924+0000","last_peered":"2024-09-17T04:23:26.356924+0000","last_clean":"2024-09-17T04:23:26.356924+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:26.356924+0000","last_undegraded":"2024-09-17T04:23:26.356924+0000","last_fullsized":"2024-09-17T04:23:26.356924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.333973+0000","last_change":"2024-09-17T04:23:23.333973+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.333973+0000","last_undegraded":"2024-09-17T04:23:23.333973+0000","last_fullsized":"2024-09-17T04:23:23.333973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339185+0000","last_change":"2024-09-17T04:23:23.339185+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339185+0000","last_undegraded":"2024-09-17T04:23:23.339185+0000","last_fullsized":"2024-09-17T04:23:23.339185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338532+0000","last_change":"2024-09-17T04:23:23.338532+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338532+0000","last_undegraded":"2024-09-17T04:23:23.338532+0000","last_fullsized":"2024-09-17T04:23:23.338532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.338741+0000","last_change":"2024-09-17T04:23:23.338741+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.338741+0000","last_undegraded":"2024-09-17T04:23:23.338741+0000","last_fullsized":"2024-09-17T04:23:23.338741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.339480+0000","last_change":"2024-09-17T04:23:23.339480+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.339480+0000","last_undegraded":"2024-09-17T04:23:23.339480+0000","last_fullsized":"2024-09-17T04:23:23.339480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.337938+0000","last_change":"2024-09-17T04:23:23.337938+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.337938+0000","last_undegraded":"2024-09-17T04:23:23.337938+0000","last_fullsized":"2024-09-17T04:23:23.337938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:23:24.326807+0000","last_change":"2024-09-17T04:23:24.326807+0000","last_active":"2024-09-17T04:23:24.326807+0000","last_peered":"2024-09-17T04:23:24.326807+0000","last_clean":"2024-09-17T04:23:24.326807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:24.326807+0000","last_undegraded":"2024-09-17T04:23:24.326807+0000","last_fullsized":"2024-09-17T04:23:24.326807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T04:23:23.336994+0000","last_change":"2024-09-17T04:23:23.336994+0000","last_active":"2024-09-17T04:23:23.321395+0000","last_peered":"2024-09-17T04:23:23.321395+0000","last_clean":"2024-09-17T04:23:23.321395+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:23:23.336994+0000","last_undegraded":"2024-09-17T04:23:23.336994+0000","last_fullsized":"2024-09-17T04:23:23.336994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:30.163 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T04:23:30.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.164 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-17T04:23:30.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.164 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T04:23:30.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T04:23:30.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T04:23:30.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.337819+0000', 'last_change': '2024-09-17T04:23:23.337819+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.337819+0000', 'last_undegraded': '2024-09-17T04:23:23.337819+0000', 'last_fullsized': '2024-09-17T04:23:23.337819+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T04:23:30.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.334047+0000', 'last_change': '2024-09-17T04:23:23.334047+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.334047+0000', 'last_undegraded': '2024-09-17T04:23:23.334047+0000', 'last_fullsized': '2024-09-17T04:23:23.334047+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.337495+0000', 'last_change': '2024-09-17T04:23:23.337495+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.337495+0000', 'last_undegraded': '2024-09-17T04:23:23.337495+0000', 'last_fullsized': '2024-09-17T04:23:23.337495+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-17T04:23:30.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.335100+0000', 'last_change': '2024-09-17T04:23:23.335100+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.335100+0000', 'last_undegraded': '2024-09-17T04:23:23.335100+0000', 'last_fullsized': '2024-09-17T04:23:23.335100+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333800+0000', 'last_change': '2024-09-17T04:23:23.333800+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333800+0000', 'last_undegraded': '2024-09-17T04:23:23.333800+0000', 'last_fullsized': '2024-09-17T04:23:23.333800+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-17T04:23:30.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.336152+0000', 'last_change': '2024-09-17T04:23:23.336152+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.336152+0000', 'last_undegraded': '2024-09-17T04:23:23.336152+0000', 'last_fullsized': '2024-09-17T04:23:23.336152+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333766+0000', 'last_change': '2024-09-17T04:23:23.333766+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333766+0000', 'last_undegraded': '2024-09-17T04:23:23.333766+0000', 'last_fullsized': '2024-09-17T04:23:23.333766+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T04:23:30.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.334229+0000', 'last_change': '2024-09-17T04:23:23.334229+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.334229+0000', 'last_undegraded': '2024-09-17T04:23:23.334229+0000', 'last_fullsized': '2024-09-17T04:23:23.334229+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T04:23:30.172 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T04:23:30.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.172 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-17T04:23:30.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.332605+0000', 'last_change': '2024-09-17T04:23:23.332605+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.332605+0000', 'last_undegraded': '2024-09-17T04:23:23.332605+0000', 'last_fullsized': '2024-09-17T04:23:23.332605+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T04:23:30.172 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T04:23:30.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.173 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T04:23:30.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333262+0000', 'last_change': '2024-09-17T04:23:23.333262+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333262+0000', 'last_undegraded': '2024-09-17T04:23:23.333262+0000', 'last_fullsized': '2024-09-17T04:23:23.333262+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T04:23:30.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T04:23:30.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T04:23:30.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333323+0000', 'last_change': '2024-09-17T04:23:23.333323+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333323+0000', 'last_undegraded': '2024-09-17T04:23:23.333323+0000', 'last_fullsized': '2024-09-17T04:23:23.333323+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T04:23:30.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T04:23:30.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T04:23:30.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.175 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-17T04:23:30.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.338477+0000', 'last_change': '2024-09-17T04:23:23.338477+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.338477+0000', 'last_undegraded': '2024-09-17T04:23:23.338477+0000', 'last_fullsized': '2024-09-17T04:23:23.338477+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-17T04:23:30.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.176 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T04:23:30.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333298+0000', 'last_change': '2024-09-17T04:23:23.333298+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333298+0000', 'last_undegraded': '2024-09-17T04:23:23.333298+0000', 'last_fullsized': '2024-09-17T04:23:23.333298+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T04:23:30.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T04:23:30.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.177 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-17T04:23:30.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.338740+0000', 'last_change': '2024-09-17T04:23:23.338740+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.338740+0000', 'last_undegraded': '2024-09-17T04:23:23.338740+0000', 'last_fullsized': '2024-09-17T04:23:23.338740+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T04:23:30.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.177 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-17T04:23:30.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.333973+0000', 'last_change': '2024-09-17T04:23:23.333973+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.333973+0000', 'last_undegraded': '2024-09-17T04:23:23.333973+0000', 'last_fullsized': '2024-09-17T04:23:23.333973+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T04:23:30.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-17T04:23:30.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.178 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-17T04:23:30.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.339185+0000', 'last_change': '2024-09-17T04:23:23.339185+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.339185+0000', 'last_undegraded': '2024-09-17T04:23:23.339185+0000', 'last_fullsized': '2024-09-17T04:23:23.339185+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T04:23:30.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T04:23:30.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T04:23:30.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.180 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-17T04:23:30.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.338532+0000', 'last_change': '2024-09-17T04:23:23.338532+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.338532+0000', 'last_undegraded': '2024-09-17T04:23:23.338532+0000', 'last_fullsized': '2024-09-17T04:23:23.338532+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T04:23:30.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.181 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-17T04:23:30.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.338741+0000', 'last_change': '2024-09-17T04:23:23.338741+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.338741+0000', 'last_undegraded': '2024-09-17T04:23:23.338741+0000', 'last_fullsized': '2024-09-17T04:23:23.338741+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.181 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-17T04:23:30.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.339480+0000', 'last_change': '2024-09-17T04:23:23.339480+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.339480+0000', 'last_undegraded': '2024-09-17T04:23:23.339480+0000', 'last_fullsized': '2024-09-17T04:23:23.339480+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T04:23:30.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-17T04:23:30.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.182 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-17T04:23:30.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.337938+0000', 'last_change': '2024-09-17T04:23:23.337938+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.337938+0000', 'last_undegraded': '2024-09-17T04:23:23.337938+0000', 'last_fullsized': '2024-09-17T04:23:23.337938+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T04:23:30.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T04:23:30.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T04:23:24.326807+0000', 'last_change': '2024-09-17T04:23:24.326807+0000', 'last_active': '2024-09-17T04:23:24.326807+0000', 'last_peered': '2024-09-17T04:23:24.326807+0000', 'last_clean': '2024-09-17T04:23:24.326807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:24.326807+0000', 'last_undegraded': '2024-09-17T04:23:24.326807+0000', 'last_fullsized': '2024-09-17T04:23:24.326807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:24.326807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T04:23:30.183 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-17T04:23:30.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T04:23:23.336994+0000', 'last_change': '2024-09-17T04:23:23.336994+0000', 'last_active': '2024-09-17T04:23:23.321395+0000', 'last_peered': '2024-09-17T04:23:23.321395+0000', 'last_clean': '2024-09-17T04:23:23.321395+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T04:23:23.336994+0000', 'last_undegraded': '2024-09-17T04:23:23.336994+0000', 'last_fullsized': '2024-09-17T04:23:23.336994+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'last_clean_scrub_stamp': '2024-09-17T04:23:23.321395+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T04:23:30.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T04:23:30.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 -- 172.21.15.63:0/1780647112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580b9b70 msgr2=0x7fb4580cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 --2- 172.21.15.63:0/1780647112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580b9b70 0x7fb4580cf090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009830 tx=0x7fb44c02a510 comp rx=0 tx=0).stop 2024-09-17T04:23:30.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 -- 172.21.15.63:0/1780647112 shutdown_connections 2024-09-17T04:23:30.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 --2- 172.21.15.63:0/1780647112 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580b9b70 0x7fb4580cf090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 --2- 172.21.15.63:0/1780647112 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580d2ed0 0x7fb4580d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 -- 172.21.15.63:0/1780647112 >> 172.21.15.63:0/1780647112 conn(0x7fb45808bfc0 msgr2=0x7fb45809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 -- 172.21.15.63:0/1780647112 shutdown_connections 2024-09-17T04:23:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.316+0000 7fb45dd82640 1 -- 172.21.15.63:0/1780647112 wait complete. 2024-09-17T04:23:30.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.318+0000 7fb45dd82640 1 Processor -- start 2024-09-17T04:23:30.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.318+0000 7fb45dd82640 1 -- start start 2024-09-17T04:23:30.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580b9b70 0x7fb4580ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 0x7fb45814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4580d4940 con 0x7fb4580d2ed0 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb4580cfde0 con 0x7fb4580cf5d0 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.319+0000 7fb45dd82640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb4580d4ac0 con 0x7fb4580b9b70 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48630/0 (socket says 172.21.15.63:48630) 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 -- 172.21.15.63:0/445508700 learned_addr learned my addr 172.21.15.63:0/445508700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb4577fe640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580b9b70 0x7fb4580ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb456ffd640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 0x7fb45814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 -- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580b9b70 msgr2=0x7fb4580ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580b9b70 0x7fb4580ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 -- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 msgr2=0x7fb45814e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 0x7fb45814e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 -- 172.21.15.63:0/445508700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4580caa70 con 0x7fb4580d2ed0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb456ffd640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 0x7fb45814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb457fff640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c730 tx=0x7fb45000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb450017070 con 0x7fb4580d2ed0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb450003c60 con 0x7fb4580d2ed0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45814ed90 con 0x7fb4580d2ed0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4500052d0 con 0x7fb4580d2ed0 2024-09-17T04:23:30.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.320+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4580ce800 con 0x7fb4580d2ed0 2024-09-17T04:23:30.323 INFO:tasks.ceph.mds.b.smithi112.stderr:2024-09-17T04:23:30.322+0000 7f7dcab6c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T04:23:30.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.321+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4580d5050 con 0x7fb4580d2ed0 2024-09-17T04:23:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.322+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb45001a070 con 0x7fb4580d2ed0 2024-09-17T04:23:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.323+0000 7fb43ffff640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 0x7fb44407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.323+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb45009a370 con 0x7fb4580d2ed0 2024-09-17T04:23:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.323+0000 7fb4577fe640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 0x7fb44407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.323+0000 7fb4577fe640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 0x7fb44407b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb44800bb30 tx=0x7fb44800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:30.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.327+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4500620e0 con 0x7fb4580d2ed0 2024-09-17T04:23:30.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.587+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb4580d0440 con 0x7fb4580d2ed0 2024-09-17T04:23:30.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.588+0000 7fb43ffff640 1 -- 172.21.15.63:0/445508700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1212 (secure 0 0 0) 0x7fb450066b10 con 0x7fb4580d2ed0 2024-09-17T04:23:30.588 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:30.588 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726546993,"num_in_osds":8,"osd_in_since":1726546983,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":46},{"state_name":"active+clean","count":30},{"state_name":"creating+peering","count":21}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590528,"bytes_used":224288768,"bytes_avail":772869824512,"bytes_total":773094113280,"unknown_pgs_ratio":0.47422680258750916,"inactive_pgs_ratio":0.2164948433637619,"write_bytes_sec":403,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4393}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T04:23:00.009730+0000","services":{}},"progress_events":{}} 2024-09-17T04:23:30.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.590+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 msgr2=0x7fb44407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.590+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 0x7fb44407b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb44800bb30 tx=0x7fb44800b2e0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.590+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 msgr2=0x7fb4580cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.590+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c730 tx=0x7fb45000cbf0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 shutdown_connections 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078bc0 0x7fb44407b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4580cf5d0 0x7fb45814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4580d2ed0 0x7fb4580cb7d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 --2- 172.21.15.63:0/445508700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4580b9b70 0x7fb4580ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 >> 172.21.15.63:0/445508700 conn(0x7fb45808bfc0 msgr2=0x7fb458161d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 shutdown_connections 2024-09-17T04:23:30.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.591+0000 7fb45dd82640 1 -- 172.21.15.63:0/445508700 wait complete. 2024-09-17T04:23:30.601 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T04:23:30.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 -- 172.21.15.63:0/1503645335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11640cf320 msgr2=0x7f11640d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 --2- 172.21.15.63:0/1503645335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11640cf320 0x7f11640d0980 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f115c005fd0 tx=0x7f115c02a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 -- 172.21.15.63:0/1503645335 shutdown_connections 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 --2- 172.21.15.63:0/1503645335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11640cf320 0x7f11640d0980 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 --2- 172.21.15.63:0/1503645335 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11641600b0 0x7f11640ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 -- 172.21.15.63:0/1503645335 >> 172.21.15.63:0/1503645335 conn(0x7f116406d4f0 msgr2=0x7f1164071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 -- 172.21.15.63:0/1503645335 shutdown_connections 2024-09-17T04:23:30.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.718+0000 7f116bfc3640 1 -- 172.21.15.63:0/1503645335 wait complete. 2024-09-17T04:23:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.720+0000 7f116bfc3640 1 Processor -- start 2024-09-17T04:23:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.720+0000 7f116bfc3640 1 -- start start 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11640b7cc0 0x7f11640c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11640cf320 0x7f11640b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d1410 con 0x7f11641600b0 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d1290 con 0x7f11640cf320 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116bfc3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f11640d1590 con 0x7f11640b7cc0 2024-09-17T04:23:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116a560640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116a560640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35980/0 (socket says 172.21.15.63:35980) 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116a560640 1 -- 172.21.15.63:0/3286716038 learned_addr learned my addr 172.21.15.63:0/3286716038 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f116955e640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11640cf320 0x7f11640b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.721+0000 7f1169d5f640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11640b7cc0 0x7f11640c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 -- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11640b7cc0 msgr2=0x7f11640c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11640b7cc0 0x7f11640c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 -- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11640cf320 msgr2=0x7f11640b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11640cf320 0x7f11640b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 -- 172.21.15.63:0/3286716038 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11641e68b0 con 0x7f11641600b0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116a560640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f115c009230 tx=0x7f115c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c03e030 con 0x7f11641600b0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f115c003c20 con 0x7f11641600b0 2024-09-17T04:23:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115c035040 con 0x7f11641600b0 2024-09-17T04:23:30.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641e6d80 con 0x7f11641600b0 2024-09-17T04:23:30.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.722+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11640cb970 con 0x7f11641600b0 2024-09-17T04:23:30.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.723+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11640d1b20 con 0x7f11641600b0 2024-09-17T04:23:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.724+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f115c041030 con 0x7f11641600b0 2024-09-17T04:23:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.724+0000 7f11627fc640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 0x7f115007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.724+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f115c0bb160 con 0x7f11641600b0 2024-09-17T04:23:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.725+0000 7f1169d5f640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 0x7f115007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.725+0000 7f1169d5f640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 0x7f115007b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f1154009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.729+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f115c082f50 con 0x7f11641600b0 2024-09-17T04:23:30.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.910+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11641e63f0 con 0x7f1150078bc0 2024-09-17T04:23:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.915+0000 7f11627fc640 1 -- 172.21.15.63:0/3286716038 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7f1154003970 con 0x7f1150078bc0 2024-09-17T04:23:30.917 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:30.918 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:30.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 msgr2=0x7f115007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 0x7f115007b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1154005fd0 tx=0x7f1154009500 comp rx=0 tx=0).stop 2024-09-17T04:23:30.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 msgr2=0x7f11640b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:30.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f115c009230 tx=0x7f115c003820 comp rx=0 tx=0).stop 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 shutdown_connections 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078bc0 0x7f115007b0d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f11640cf320 0x7f11640b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11641600b0 0x7f11640b36d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 --2- 172.21.15.63:0/3286716038 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f11640b7cc0 0x7f11640c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 >> 172.21.15.63:0/3286716038 conn(0x7f116406d4f0 msgr2=0x7f1164159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 shutdown_connections 2024-09-17T04:23:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:30.918+0000 7f116bfc3640 1 -- 172.21.15.63:0/3286716038 wait complete. 2024-09-17T04:23:30.929 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T04:23:30.399567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2844,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2912256,"data_stored":1761232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.068131"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659274+0000","last_change":"2024-09-17T04:23:25.376557+0000","last_active":"2024-09-17T04:23:26.659274+0000","last_peered":"2024-09-17T04:23:26.659274+0000","last_clean":"2024-09-17T04:23:26.659274+0000","last_became_active":"2024-09-17T04:23:25.376196+0000","last_became_peered":"2024-09-17T04:23:25.376196+0000","last_unstale":"2024-09-17T04:23:26.659274+0000","last_undegraded":"2024-09-17T04:23:26.659274+0000","last_fullsized":"2024-09-17T04:23:26.659274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:31.126084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657398+0000","last_change":"2024-09-17T04:23:25.357621+0000","last_active":"2024-09-17T04:23:26.657398+0000","last_peered":"2024-09-17T04:23:26.657398+0000","last_clean":"2024-09-17T04:23:26.657398+0000","last_became_active":"2024-09-17T04:23:25.355965+0000","last_became_peered":"2024-09-17T04:23:25.355965+0000","last_unstale":"2024-09-17T04:23:26.657398+0000","last_undegraded":"2024-09-17T04:23:26.657398+0000","last_fullsized":"2024-09-17T04:23:26.657398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659057+0000","last_change":"2024-09-17T04:23:25.373604+0000","last_active":"2024-09-17T04:23:26.659057+0000","last_peered":"2024-09-17T04:23:26.659057+0000","last_clean":"2024-09-17T04:23:26.659057+0000","last_became_active":"2024-09-17T04:23:25.373309+0000","last_became_peered":"2024-09-17T04:23:25.373309+0000","last_unstale":"2024-09-17T04:23:26.659057+0000","last_undegraded":"2024-09-17T04:23:26.659057+0000","last_fullsized":"2024-09-17T04:23:26.659057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658926+0000","last_change":"2024-09-17T04:23:25.379332+0000","last_active":"2024-09-17T04:23:26.658926+0000","last_peered":"2024-09-17T04:23:26.658926+0000","last_clean":"2024-09-17T04:23:26.658926+0000","last_became_active":"2024-09-17T04:23:25.377519+0000","last_became_peered":"2024-09-17T04:23:25.377519+0000","last_unstale":"2024-09-17T04:23:26.658926+0000","last_undegraded":"2024-09-17T04:23:26.658926+0000","last_fullsized":"2024-09-17T04:23:26.658926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:14.203036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656178+0000","last_change":"2024-09-17T04:23:25.381475+0000","last_active":"2024-09-17T04:23:26.656178+0000","last_peered":"2024-09-17T04:23:26.656178+0000","last_clean":"2024-09-17T04:23:26.656178+0000","last_became_active":"2024-09-17T04:23:25.381163+0000","last_became_peered":"2024-09-17T04:23:25.381163+0000","last_unstale":"2024-09-17T04:23:26.656178+0000","last_undegraded":"2024-09-17T04:23:26.656178+0000","last_fullsized":"2024-09-17T04:23:26.656178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659283+0000","last_change":"2024-09-17T04:23:25.373332+0000","last_active":"2024-09-17T04:23:26.659283+0000","last_peered":"2024-09-17T04:23:26.659283+0000","last_clean":"2024-09-17T04:23:26.659283+0000","last_became_active":"2024-09-17T04:23:25.372980+0000","last_became_peered":"2024-09-17T04:23:25.372980+0000","last_unstale":"2024-09-17T04:23:26.659283+0000","last_undegraded":"2024-09-17T04:23:26.659283+0000","last_fullsized":"2024-09-17T04:23:26.659283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.403052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468977+0000","last_change":"2024-09-17T04:23:25.365489+0000","last_active":"2024-09-17T04:23:26.468977+0000","last_peered":"2024-09-17T04:23:26.468977+0000","last_clean":"2024-09-17T04:23:26.468977+0000","last_became_active":"2024-09-17T04:23:25.365166+0000","last_became_peered":"2024-09-17T04:23:25.365166+0000","last_unstale":"2024-09-17T04:23:26.468977+0000","last_undegraded":"2024-09-17T04:23:26.468977+0000","last_fullsized":"2024-09-17T04:23:26.468977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468815+0000","last_change":"2024-09-17T04:23:25.369673+0000","last_active":"2024-09-17T04:23:26.468815+0000","last_peered":"2024-09-17T04:23:26.468815+0000","last_clean":"2024-09-17T04:23:26.468815+0000","last_became_active":"2024-09-17T04:23:25.369360+0000","last_became_peered":"2024-09-17T04:23:25.369360+0000","last_unstale":"2024-09-17T04:23:26.468815+0000","last_undegraded":"2024-09-17T04:23:26.468815+0000","last_fullsized":"2024-09-17T04:23:26.468815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360528+0000","last_change":"2024-09-17T04:23:25.365165+0000","last_active":"2024-09-17T04:23:26.360528+0000","last_peered":"2024-09-17T04:23:26.360528+0000","last_clean":"2024-09-17T04:23:26.360528+0000","last_became_active":"2024-09-17T04:23:25.364840+0000","last_became_peered":"2024-09-17T04:23:25.364840+0000","last_unstale":"2024-09-17T04:23:26.360528+0000","last_undegraded":"2024-09-17T04:23:26.360528+0000","last_fullsized":"2024-09-17T04:23:26.360528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657001+0000","last_change":"2024-09-17T04:23:25.363017+0000","last_active":"2024-09-17T04:23:26.657001+0000","last_peered":"2024-09-17T04:23:26.657001+0000","last_clean":"2024-09-17T04:23:26.657001+0000","last_became_active":"2024-09-17T04:23:25.362696+0000","last_became_peered":"2024-09-17T04:23:25.362696+0000","last_unstale":"2024-09-17T04:23:26.657001+0000","last_undegraded":"2024-09-17T04:23:26.657001+0000","last_fullsized":"2024-09-17T04:23:26.657001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:29.184786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656448+0000","last_change":"2024-09-17T04:23:25.366854+0000","last_active":"2024-09-17T04:23:26.656448+0000","last_peered":"2024-09-17T04:23:26.656448+0000","last_clean":"2024-09-17T04:23:26.656448+0000","last_became_active":"2024-09-17T04:23:25.366508+0000","last_became_peered":"2024-09-17T04:23:25.366508+0000","last_unstale":"2024-09-17T04:23:26.656448+0000","last_undegraded":"2024-09-17T04:23:26.656448+0000","last_fullsized":"2024-09-17T04:23:26.656448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:55.579822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656798+0000","last_change":"2024-09-17T04:23:25.363990+0000","last_active":"2024-09-17T04:23:26.656798+0000","last_peered":"2024-09-17T04:23:26.656798+0000","last_clean":"2024-09-17T04:23:26.656798+0000","last_became_active":"2024-09-17T04:23:25.363609+0000","last_became_peered":"2024-09-17T04:23:25.363609+0000","last_unstale":"2024-09-17T04:23:26.656798+0000","last_undegraded":"2024-09-17T04:23:26.656798+0000","last_fullsized":"2024-09-17T04:23:26.656798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659347+0000","last_change":"2024-09-17T04:23:25.372922+0000","last_active":"2024-09-17T04:23:26.659347+0000","last_peered":"2024-09-17T04:23:26.659347+0000","last_clean":"2024-09-17T04:23:26.659347+0000","last_became_active":"2024-09-17T04:23:25.372597+0000","last_became_peered":"2024-09-17T04:23:25.372597+0000","last_unstale":"2024-09-17T04:23:26.659347+0000","last_undegraded":"2024-09-17T04:23:26.659347+0000","last_fullsized":"2024-09-17T04:23:26.659347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:46.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468848+0000","last_change":"2024-09-17T04:23:25.369858+0000","last_active":"2024-09-17T04:23:26.468848+0000","last_peered":"2024-09-17T04:23:26.468848+0000","last_clean":"2024-09-17T04:23:26.468848+0000","last_became_active":"2024-09-17T04:23:25.369523+0000","last_became_peered":"2024-09-17T04:23:25.369523+0000","last_unstale":"2024-09-17T04:23:26.468848+0000","last_undegraded":"2024-09-17T04:23:26.468848+0000","last_fullsized":"2024-09-17T04:23:26.468848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657526+0000","last_change":"2024-09-17T04:23:25.372496+0000","last_active":"2024-09-17T04:23:26.657526+0000","last_peered":"2024-09-17T04:23:26.657526+0000","last_clean":"2024-09-17T04:23:26.657526+0000","last_became_active":"2024-09-17T04:23:25.371988+0000","last_became_peered":"2024-09-17T04:23:25.371988+0000","last_unstale":"2024-09-17T04:23:26.657526+0000","last_undegraded":"2024-09-17T04:23:26.657526+0000","last_fullsized":"2024-09-17T04:23:26.657526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656520+0000","last_change":"2024-09-17T04:23:25.370154+0000","last_active":"2024-09-17T04:23:26.656520+0000","last_peered":"2024-09-17T04:23:26.656520+0000","last_clean":"2024-09-17T04:23:26.656520+0000","last_became_active":"2024-09-17T04:23:25.369846+0000","last_became_peered":"2024-09-17T04:23:25.369846+0000","last_unstale":"2024-09-17T04:23:26.656520+0000","last_undegraded":"2024-09-17T04:23:26.656520+0000","last_fullsized":"2024-09-17T04:23:26.656520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656790+0000","last_change":"2024-09-17T04:23:25.374875+0000","last_active":"2024-09-17T04:23:26.656790+0000","last_peered":"2024-09-17T04:23:26.656790+0000","last_clean":"2024-09-17T04:23:26.656790+0000","last_became_active":"2024-09-17T04:23:25.374565+0000","last_became_peered":"2024-09-17T04:23:25.374565+0000","last_unstale":"2024-09-17T04:23:26.656790+0000","last_undegraded":"2024-09-17T04:23:26.656790+0000","last_fullsized":"2024-09-17T04:23:26.656790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468983+0000","last_change":"2024-09-17T04:23:25.371408+0000","last_active":"2024-09-17T04:23:26.468983+0000","last_peered":"2024-09-17T04:23:26.468983+0000","last_clean":"2024-09-17T04:23:26.468983+0000","last_became_active":"2024-09-17T04:23:25.371085+0000","last_became_peered":"2024-09-17T04:23:25.371085+0000","last_unstale":"2024-09-17T04:23:26.468983+0000","last_undegraded":"2024-09-17T04:23:26.468983+0000","last_fullsized":"2024-09-17T04:23:26.468983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.992287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657086+0000","last_change":"2024-09-17T04:23:25.370366+0000","last_active":"2024-09-17T04:23:26.657086+0000","last_peered":"2024-09-17T04:23:26.657086+0000","last_clean":"2024-09-17T04:23:26.657086+0000","last_became_active":"2024-09-17T04:23:25.369986+0000","last_became_peered":"2024-09-17T04:23:25.369986+0000","last_unstale":"2024-09-17T04:23:26.657086+0000","last_undegraded":"2024-09-17T04:23:26.657086+0000","last_fullsized":"2024-09-17T04:23:26.657086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657687+0000","last_change":"2024-09-17T04:23:25.363653+0000","last_active":"2024-09-17T04:23:26.657687+0000","last_peered":"2024-09-17T04:23:26.657687+0000","last_clean":"2024-09-17T04:23:26.657687+0000","last_became_active":"2024-09-17T04:23:25.363060+0000","last_became_peered":"2024-09-17T04:23:25.363060+0000","last_unstale":"2024-09-17T04:23:26.657687+0000","last_undegraded":"2024-09-17T04:23:26.657687+0000","last_fullsized":"2024-09-17T04:23:26.657687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656912+0000","last_change":"2024-09-17T04:23:25.365226+0000","last_active":"2024-09-17T04:23:26.656912+0000","last_peered":"2024-09-17T04:23:26.656912+0000","last_clean":"2024-09-17T04:23:26.656912+0000","last_became_active":"2024-09-17T04:23:25.364858+0000","last_became_peered":"2024-09-17T04:23:25.364858+0000","last_unstale":"2024-09-17T04:23:26.656912+0000","last_undegraded":"2024-09-17T04:23:26.656912+0000","last_fullsized":"2024-09-17T04:23:26.656912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468547+0000","last_change":"2024-09-17T04:23:25.363571+0000","last_active":"2024-09-17T04:23:26.468547+0000","last_peered":"2024-09-17T04:23:26.468547+0000","last_clean":"2024-09-17T04:23:26.468547+0000","last_became_active":"2024-09-17T04:23:25.363235+0000","last_became_peered":"2024-09-17T04:23:25.363235+0000","last_unstale":"2024-09-17T04:23:26.468547+0000","last_undegraded":"2024-09-17T04:23:26.468547+0000","last_fullsized":"2024-09-17T04:23:26.468547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360260+0000","last_change":"2024-09-17T04:23:25.363674+0000","last_active":"2024-09-17T04:23:26.360260+0000","last_peered":"2024-09-17T04:23:26.360260+0000","last_clean":"2024-09-17T04:23:26.360260+0000","last_became_active":"2024-09-17T04:23:25.363334+0000","last_became_peered":"2024-09-17T04:23:25.363334+0000","last_unstale":"2024-09-17T04:23:26.360260+0000","last_undegraded":"2024-09-17T04:23:26.360260+0000","last_fullsized":"2024-09-17T04:23:26.360260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.913452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657300+0000","last_change":"2024-09-17T04:23:24.353312+0000","last_active":"2024-09-17T04:23:26.657300+0000","last_peered":"2024-09-17T04:23:26.657300+0000","last_clean":"2024-09-17T04:23:26.657300+0000","last_became_active":"2024-09-17T04:23:24.352973+0000","last_became_peered":"2024-09-17T04:23:24.352973+0000","last_unstale":"2024-09-17T04:23:26.657300+0000","last_undegraded":"2024-09-17T04:23:26.657300+0000","last_fullsized":"2024-09-17T04:23:26.657300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:00.251669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657690+0000","last_change":"2024-09-17T04:23:25.367192+0000","last_active":"2024-09-17T04:23:26.657690+0000","last_peered":"2024-09-17T04:23:26.657690+0000","last_clean":"2024-09-17T04:23:26.657690+0000","last_became_active":"2024-09-17T04:23:25.366787+0000","last_became_peered":"2024-09-17T04:23:25.366787+0000","last_unstale":"2024-09-17T04:23:26.657690+0000","last_undegraded":"2024-09-17T04:23:26.657690+0000","last_fullsized":"2024-09-17T04:23:26.657690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468424+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.468424+0000","last_peered":"2024-09-17T04:23:26.468424+0000","last_clean":"2024-09-17T04:23:26.468424+0000","last_became_active":"2024-09-17T04:23:24.353296+0000","last_became_peered":"2024-09-17T04:23:24.353296+0000","last_unstale":"2024-09-17T04:23:26.468424+0000","last_undegraded":"2024-09-17T04:23:26.468424+0000","last_fullsized":"2024-09-17T04:23:26.468424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656443+0000","last_change":"2024-09-17T04:23:24.354209+0000","last_active":"2024-09-17T04:23:26.656443+0000","last_peered":"2024-09-17T04:23:26.656443+0000","last_clean":"2024-09-17T04:23:26.656443+0000","last_became_active":"2024-09-17T04:23:24.353857+0000","last_became_peered":"2024-09-17T04:23:24.353857+0000","last_unstale":"2024-09-17T04:23:26.656443+0000","last_undegraded":"2024-09-17T04:23:26.656443+0000","last_fullsized":"2024-09-17T04:23:26.656443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656651+0000","last_change":"2024-09-17T04:23:25.367243+0000","last_active":"2024-09-17T04:23:26.656651+0000","last_peered":"2024-09-17T04:23:26.656651+0000","last_clean":"2024-09-17T04:23:26.656651+0000","last_became_active":"2024-09-17T04:23:25.366397+0000","last_became_peered":"2024-09-17T04:23:25.366397+0000","last_unstale":"2024-09-17T04:23:26.656651+0000","last_undegraded":"2024-09-17T04:23:26.656651+0000","last_fullsized":"2024-09-17T04:23:26.656651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468794+0000","last_change":"2024-09-17T04:23:24.352132+0000","last_active":"2024-09-17T04:23:26.468794+0000","last_peered":"2024-09-17T04:23:26.468794+0000","last_clean":"2024-09-17T04:23:26.468794+0000","last_became_active":"2024-09-17T04:23:24.351783+0000","last_became_peered":"2024-09-17T04:23:24.351783+0000","last_unstale":"2024-09-17T04:23:26.468794+0000","last_undegraded":"2024-09-17T04:23:26.468794+0000","last_fullsized":"2024-09-17T04:23:26.468794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657677+0000","last_change":"2024-09-17T04:23:25.357396+0000","last_active":"2024-09-17T04:23:26.657677+0000","last_peered":"2024-09-17T04:23:26.657677+0000","last_clean":"2024-09-17T04:23:26.657677+0000","last_became_active":"2024-09-17T04:23:25.357068+0000","last_became_peered":"2024-09-17T04:23:25.357068+0000","last_unstale":"2024-09-17T04:23:26.657677+0000","last_undegraded":"2024-09-17T04:23:26.657677+0000","last_fullsized":"2024-09-17T04:23:26.657677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360646+0000","last_change":"2024-09-17T04:23:25.373865+0000","last_active":"2024-09-17T04:23:26.360646+0000","last_peered":"2024-09-17T04:23:26.360646+0000","last_clean":"2024-09-17T04:23:26.360646+0000","last_became_active":"2024-09-17T04:23:25.373552+0000","last_became_peered":"2024-09-17T04:23:25.373552+0000","last_unstale":"2024-09-17T04:23:26.360646+0000","last_undegraded":"2024-09-17T04:23:26.360646+0000","last_fullsized":"2024-09-17T04:23:26.360646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.547724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468703+0000","last_change":"2024-09-17T04:23:24.356471+0000","last_active":"2024-09-17T04:23:26.468703+0000","last_peered":"2024-09-17T04:23:26.468703+0000","last_clean":"2024-09-17T04:23:26.468703+0000","last_became_active":"2024-09-17T04:23:24.356116+0000","last_became_peered":"2024-09-17T04:23:24.356116+0000","last_unstale":"2024-09-17T04:23:26.468703+0000","last_undegraded":"2024-09-17T04:23:26.468703+0000","last_fullsized":"2024-09-17T04:23:26.468703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659061+0000","last_change":"2024-09-17T04:23:25.375376+0000","last_active":"2024-09-17T04:23:26.659061+0000","last_peered":"2024-09-17T04:23:26.659061+0000","last_clean":"2024-09-17T04:23:26.659061+0000","last_became_active":"2024-09-17T04:23:25.375049+0000","last_became_peered":"2024-09-17T04:23:25.375049+0000","last_unstale":"2024-09-17T04:23:26.659061+0000","last_undegraded":"2024-09-17T04:23:26.659061+0000","last_fullsized":"2024-09-17T04:23:26.659061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:37.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657777+0000","last_change":"2024-09-17T04:23:24.343096+0000","last_active":"2024-09-17T04:23:26.657777+0000","last_peered":"2024-09-17T04:23:26.657777+0000","last_clean":"2024-09-17T04:23:26.657777+0000","last_became_active":"2024-09-17T04:23:24.340534+0000","last_became_peered":"2024-09-17T04:23:24.340534+0000","last_unstale":"2024-09-17T04:23:26.657777+0000","last_undegraded":"2024-09-17T04:23:26.657777+0000","last_fullsized":"2024-09-17T04:23:26.657777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656521+0000","last_change":"2024-09-17T04:23:25.372210+0000","last_active":"2024-09-17T04:23:26.656521+0000","last_peered":"2024-09-17T04:23:26.656521+0000","last_clean":"2024-09-17T04:23:26.656521+0000","last_became_active":"2024-09-17T04:23:25.371825+0000","last_became_peered":"2024-09-17T04:23:25.371825+0000","last_unstale":"2024-09-17T04:23:26.656521+0000","last_undegraded":"2024-09-17T04:23:26.656521+0000","last_fullsized":"2024-09-17T04:23:26.656521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:26.115764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659095+0000","last_change":"2024-09-17T04:23:25.381294+0000","last_active":"2024-09-17T04:23:26.659095+0000","last_peered":"2024-09-17T04:23:26.659095+0000","last_clean":"2024-09-17T04:23:26.659095+0000","last_became_active":"2024-09-17T04:23:25.379816+0000","last_became_peered":"2024-09-17T04:23:25.379816+0000","last_unstale":"2024-09-17T04:23:26.659095+0000","last_undegraded":"2024-09-17T04:23:26.659095+0000","last_fullsized":"2024-09-17T04:23:26.659095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:18.964734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468364+0000","last_change":"2024-09-17T04:23:24.352552+0000","last_active":"2024-09-17T04:23:26.468364+0000","last_peered":"2024-09-17T04:23:26.468364+0000","last_clean":"2024-09-17T04:23:26.468364+0000","last_became_active":"2024-09-17T04:23:24.352220+0000","last_became_peered":"2024-09-17T04:23:24.352220+0000","last_unstale":"2024-09-17T04:23:26.468364+0000","last_undegraded":"2024-09-17T04:23:26.468364+0000","last_fullsized":"2024-09-17T04:23:26.468364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468554+0000","last_change":"2024-09-17T04:23:25.367603+0000","last_active":"2024-09-17T04:23:26.468554+0000","last_peered":"2024-09-17T04:23:26.468554+0000","last_clean":"2024-09-17T04:23:26.468554+0000","last_became_active":"2024-09-17T04:23:25.367219+0000","last_became_peered":"2024-09-17T04:23:25.367219+0000","last_unstale":"2024-09-17T04:23:26.468554+0000","last_undegraded":"2024-09-17T04:23:26.468554+0000","last_fullsized":"2024-09-17T04:23:26.468554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:09.908355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656699+0000","last_change":"2024-09-17T04:23:24.354050+0000","last_active":"2024-09-17T04:23:26.656699+0000","last_peered":"2024-09-17T04:23:26.656699+0000","last_clean":"2024-09-17T04:23:26.656699+0000","last_became_active":"2024-09-17T04:23:24.353683+0000","last_became_peered":"2024-09-17T04:23:24.353683+0000","last_unstale":"2024-09-17T04:23:26.656699+0000","last_undegraded":"2024-09-17T04:23:26.656699+0000","last_fullsized":"2024-09-17T04:23:26.656699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:04.191476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658744+0000","last_change":"2024-09-17T04:23:25.376511+0000","last_active":"2024-09-17T04:23:26.658744+0000","last_peered":"2024-09-17T04:23:26.658744+0000","last_clean":"2024-09-17T04:23:26.658744+0000","last_became_active":"2024-09-17T04:23:25.376218+0000","last_became_peered":"2024-09-17T04:23:25.376218+0000","last_unstale":"2024-09-17T04:23:26.658744+0000","last_undegraded":"2024-09-17T04:23:26.658744+0000","last_fullsized":"2024-09-17T04:23:26.658744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:59.631965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360742+0000","last_change":"2024-09-17T04:23:24.339532+0000","last_active":"2024-09-17T04:23:26.360742+0000","last_peered":"2024-09-17T04:23:26.360742+0000","last_clean":"2024-09-17T04:23:26.360742+0000","last_became_active":"2024-09-17T04:23:24.338952+0000","last_became_peered":"2024-09-17T04:23:24.338952+0000","last_unstale":"2024-09-17T04:23:26.360742+0000","last_undegraded":"2024-09-17T04:23:26.360742+0000","last_fullsized":"2024-09-17T04:23:26.360742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:07.931802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659183+0000","last_change":"2024-09-17T04:23:25.378130+0000","last_active":"2024-09-17T04:23:26.659183+0000","last_peered":"2024-09-17T04:23:26.659183+0000","last_clean":"2024-09-17T04:23:26.659183+0000","last_became_active":"2024-09-17T04:23:25.377278+0000","last_became_peered":"2024-09-17T04:23:25.377278+0000","last_unstale":"2024-09-17T04:23:26.659183+0000","last_undegraded":"2024-09-17T04:23:26.659183+0000","last_fullsized":"2024-09-17T04:23:26.659183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.934488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656882+0000","last_change":"2024-09-17T04:23:24.354131+0000","last_active":"2024-09-17T04:23:26.656882+0000","last_peered":"2024-09-17T04:23:26.656882+0000","last_clean":"2024-09-17T04:23:26.656882+0000","last_became_active":"2024-09-17T04:23:24.353777+0000","last_became_peered":"2024-09-17T04:23:24.353777+0000","last_unstale":"2024-09-17T04:23:26.656882+0000","last_undegraded":"2024-09-17T04:23:26.656882+0000","last_fullsized":"2024-09-17T04:23:26.656882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659540+0000","last_change":"2024-09-17T04:23:25.379331+0000","last_active":"2024-09-17T04:23:26.659540+0000","last_peered":"2024-09-17T04:23:26.659540+0000","last_clean":"2024-09-17T04:23:26.659540+0000","last_became_active":"2024-09-17T04:23:25.377494+0000","last_became_peered":"2024-09-17T04:23:25.377494+0000","last_unstale":"2024-09-17T04:23:26.659540+0000","last_undegraded":"2024-09-17T04:23:26.659540+0000","last_fullsized":"2024-09-17T04:23:26.659540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:10.116857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656281+0000","last_change":"2024-09-17T04:23:24.349655+0000","last_active":"2024-09-17T04:23:26.656281+0000","last_peered":"2024-09-17T04:23:26.656281+0000","last_clean":"2024-09-17T04:23:26.656281+0000","last_became_active":"2024-09-17T04:23:24.349349+0000","last_became_peered":"2024-09-17T04:23:24.349349+0000","last_unstale":"2024-09-17T04:23:26.656281+0000","last_undegraded":"2024-09-17T04:23:26.656281+0000","last_fullsized":"2024-09-17T04:23:26.656281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:04.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659133+0000","last_change":"2024-09-17T04:23:25.380320+0000","last_active":"2024-09-17T04:23:26.659133+0000","last_peered":"2024-09-17T04:23:26.659133+0000","last_clean":"2024-09-17T04:23:26.659133+0000","last_became_active":"2024-09-17T04:23:25.379951+0000","last_became_peered":"2024-09-17T04:23:25.379951+0000","last_unstale":"2024-09-17T04:23:26.659133+0000","last_undegraded":"2024-09-17T04:23:26.659133+0000","last_fullsized":"2024-09-17T04:23:26.659133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:23.089918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658756+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:26.658756+0000","last_peered":"2024-09-17T04:23:26.658756+0000","last_clean":"2024-09-17T04:23:26.658756+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:26.658756+0000","last_undegraded":"2024-09-17T04:23:26.658756+0000","last_fullsized":"2024-09-17T04:23:26.658756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656250+0000","last_change":"2024-09-17T04:23:25.381586+0000","last_active":"2024-09-17T04:23:26.656250+0000","last_peered":"2024-09-17T04:23:26.656250+0000","last_clean":"2024-09-17T04:23:26.656250+0000","last_became_active":"2024-09-17T04:23:25.381261+0000","last_became_peered":"2024-09-17T04:23:25.381261+0000","last_unstale":"2024-09-17T04:23:26.656250+0000","last_undegraded":"2024-09-17T04:23:26.656250+0000","last_fullsized":"2024-09-17T04:23:26.656250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658502+0000","last_change":"2024-09-17T04:23:24.356897+0000","last_active":"2024-09-17T04:23:26.658502+0000","last_peered":"2024-09-17T04:23:26.658502+0000","last_clean":"2024-09-17T04:23:26.658502+0000","last_became_active":"2024-09-17T04:23:24.356553+0000","last_became_peered":"2024-09-17T04:23:24.356553+0000","last_unstale":"2024-09-17T04:23:26.658502+0000","last_undegraded":"2024-09-17T04:23:26.658502+0000","last_fullsized":"2024-09-17T04:23:26.658502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656883+0000","last_change":"2024-09-17T04:23:25.356801+0000","last_active":"2024-09-17T04:23:26.656883+0000","last_peered":"2024-09-17T04:23:26.656883+0000","last_clean":"2024-09-17T04:23:26.656883+0000","last_became_active":"2024-09-17T04:23:25.356450+0000","last_became_peered":"2024-09-17T04:23:25.356450+0000","last_unstale":"2024-09-17T04:23:26.656883+0000","last_undegraded":"2024-09-17T04:23:26.656883+0000","last_fullsized":"2024-09-17T04:23:26.656883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:30.495912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657024+0000","last_change":"2024-09-17T04:23:24.353192+0000","last_active":"2024-09-17T04:23:26.657024+0000","last_peered":"2024-09-17T04:23:26.657024+0000","last_clean":"2024-09-17T04:23:26.657024+0000","last_became_active":"2024-09-17T04:23:24.352863+0000","last_became_peered":"2024-09-17T04:23:24.352863+0000","last_unstale":"2024-09-17T04:23:26.657024+0000","last_undegraded":"2024-09-17T04:23:26.657024+0000","last_fullsized":"2024-09-17T04:23:26.657024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360605+0000","last_change":"2024-09-17T04:23:25.362549+0000","last_active":"2024-09-17T04:23:26.360605+0000","last_peered":"2024-09-17T04:23:26.360605+0000","last_clean":"2024-09-17T04:23:26.360605+0000","last_became_active":"2024-09-17T04:23:25.362227+0000","last_became_peered":"2024-09-17T04:23:25.362227+0000","last_unstale":"2024-09-17T04:23:26.360605+0000","last_undegraded":"2024-09-17T04:23:26.360605+0000","last_fullsized":"2024-09-17T04:23:26.360605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659359+0000","last_change":"2024-09-17T04:23:24.354097+0000","last_active":"2024-09-17T04:23:26.659359+0000","last_peered":"2024-09-17T04:23:26.659359+0000","last_clean":"2024-09-17T04:23:26.659359+0000","last_became_active":"2024-09-17T04:23:24.353583+0000","last_became_peered":"2024-09-17T04:23:24.353583+0000","last_unstale":"2024-09-17T04:23:26.659359+0000","last_undegraded":"2024-09-17T04:23:26.659359+0000","last_fullsized":"2024-09-17T04:23:26.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.874215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356924+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:26.356924+0000","last_peered":"2024-09-17T04:23:26.356924+0000","last_clean":"2024-09-17T04:23:26.356924+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:26.356924+0000","last_undegraded":"2024-09-17T04:23:26.356924+0000","last_fullsized":"2024-09-17T04:23:26.356924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656641+0000","last_change":"2024-09-17T04:23:25.370909+0000","last_active":"2024-09-17T04:23:26.656641+0000","last_peered":"2024-09-17T04:23:26.656641+0000","last_clean":"2024-09-17T04:23:26.656641+0000","last_became_active":"2024-09-17T04:23:25.370575+0000","last_became_peered":"2024-09-17T04:23:25.370575+0000","last_unstale":"2024-09-17T04:23:26.656641+0000","last_undegraded":"2024-09-17T04:23:26.656641+0000","last_fullsized":"2024-09-17T04:23:26.656641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468856+0000","last_change":"2024-09-17T04:23:24.350404+0000","last_active":"2024-09-17T04:23:26.468856+0000","last_peered":"2024-09-17T04:23:26.468856+0000","last_clean":"2024-09-17T04:23:26.468856+0000","last_became_active":"2024-09-17T04:23:24.349057+0000","last_became_peered":"2024-09-17T04:23:24.349057+0000","last_unstale":"2024-09-17T04:23:26.468856+0000","last_undegraded":"2024-09-17T04:23:26.468856+0000","last_fullsized":"2024-09-17T04:23:26.468856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657233+0000","last_change":"2024-09-17T04:23:25.356958+0000","last_active":"2024-09-17T04:23:26.657233+0000","last_peered":"2024-09-17T04:23:26.657233+0000","last_clean":"2024-09-17T04:23:26.657233+0000","last_became_active":"2024-09-17T04:23:25.356609+0000","last_became_peered":"2024-09-17T04:23:25.356609+0000","last_unstale":"2024-09-17T04:23:26.657233+0000","last_undegraded":"2024-09-17T04:23:26.657233+0000","last_fullsized":"2024-09-17T04:23:26.657233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658663+0000","last_change":"2024-09-17T04:23:24.354084+0000","last_active":"2024-09-17T04:23:26.658663+0000","last_peered":"2024-09-17T04:23:26.658663+0000","last_clean":"2024-09-17T04:23:26.658663+0000","last_became_active":"2024-09-17T04:23:24.353744+0000","last_became_peered":"2024-09-17T04:23:24.353744+0000","last_unstale":"2024-09-17T04:23:26.658663+0000","last_undegraded":"2024-09-17T04:23:26.658663+0000","last_fullsized":"2024-09-17T04:23:26.658663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360379+0000","last_change":"2024-09-17T04:23:25.356709+0000","last_active":"2024-09-17T04:23:26.360379+0000","last_peered":"2024-09-17T04:23:26.360379+0000","last_clean":"2024-09-17T04:23:26.360379+0000","last_became_active":"2024-09-17T04:23:25.356403+0000","last_became_peered":"2024-09-17T04:23:25.356403+0000","last_unstale":"2024-09-17T04:23:26.360379+0000","last_undegraded":"2024-09-17T04:23:26.360379+0000","last_fullsized":"2024-09-17T04:23:26.360379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:49.386382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656896+0000","last_change":"2024-09-17T04:23:25.367584+0000","last_active":"2024-09-17T04:23:26.656896+0000","last_peered":"2024-09-17T04:23:26.656896+0000","last_clean":"2024-09-17T04:23:26.656896+0000","last_became_active":"2024-09-17T04:23:25.366943+0000","last_became_peered":"2024-09-17T04:23:25.366943+0000","last_unstale":"2024-09-17T04:23:26.656896+0000","last_undegraded":"2024-09-17T04:23:26.656896+0000","last_fullsized":"2024-09-17T04:23:26.656896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657231+0000","last_change":"2024-09-17T04:23:25.366947+0000","last_active":"2024-09-17T04:23:26.657231+0000","last_peered":"2024-09-17T04:23:26.657231+0000","last_clean":"2024-09-17T04:23:26.657231+0000","last_became_active":"2024-09-17T04:23:25.366593+0000","last_became_peered":"2024-09-17T04:23:25.366593+0000","last_unstale":"2024-09-17T04:23:26.657231+0000","last_undegraded":"2024-09-17T04:23:26.657231+0000","last_fullsized":"2024-09-17T04:23:26.657231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.638076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659143+0000","last_change":"2024-09-17T04:23:24.351819+0000","last_active":"2024-09-17T04:23:26.659143+0000","last_peered":"2024-09-17T04:23:26.659143+0000","last_clean":"2024-09-17T04:23:26.659143+0000","last_became_active":"2024-09-17T04:23:24.351483+0000","last_became_peered":"2024-09-17T04:23:24.351483+0000","last_unstale":"2024-09-17T04:23:26.659143+0000","last_undegraded":"2024-09-17T04:23:26.659143+0000","last_fullsized":"2024-09-17T04:23:26.659143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:18.736197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468638+0000","last_change":"2024-09-17T04:23:25.369382+0000","last_active":"2024-09-17T04:23:26.468638+0000","last_peered":"2024-09-17T04:23:26.468638+0000","last_clean":"2024-09-17T04:23:26.468638+0000","last_became_active":"2024-09-17T04:23:25.369026+0000","last_became_peered":"2024-09-17T04:23:25.369026+0000","last_unstale":"2024-09-17T04:23:26.468638+0000","last_undegraded":"2024-09-17T04:23:26.468638+0000","last_fullsized":"2024-09-17T04:23:26.468638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658625+0000","last_change":"2024-09-17T04:23:24.349161+0000","last_active":"2024-09-17T04:23:26.658625+0000","last_peered":"2024-09-17T04:23:26.658625+0000","last_clean":"2024-09-17T04:23:26.658625+0000","last_became_active":"2024-09-17T04:23:24.348825+0000","last_became_peered":"2024-09-17T04:23:24.348825+0000","last_unstale":"2024-09-17T04:23:26.658625+0000","last_undegraded":"2024-09-17T04:23:26.658625+0000","last_fullsized":"2024-09-17T04:23:26.658625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.666124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659219+0000","last_change":"2024-09-17T04:23:24.353160+0000","last_active":"2024-09-17T04:23:26.659219+0000","last_peered":"2024-09-17T04:23:26.659219+0000","last_clean":"2024-09-17T04:23:26.659219+0000","last_became_active":"2024-09-17T04:23:24.352829+0000","last_became_peered":"2024-09-17T04:23:24.352829+0000","last_unstale":"2024-09-17T04:23:26.659219+0000","last_undegraded":"2024-09-17T04:23:26.659219+0000","last_fullsized":"2024-09-17T04:23:26.659219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657688+0000","last_change":"2024-09-17T04:23:25.370271+0000","last_active":"2024-09-17T04:23:26.657688+0000","last_peered":"2024-09-17T04:23:26.657688+0000","last_clean":"2024-09-17T04:23:26.657688+0000","last_became_active":"2024-09-17T04:23:25.369591+0000","last_became_peered":"2024-09-17T04:23:25.369591+0000","last_unstale":"2024-09-17T04:23:26.657688+0000","last_undegraded":"2024-09-17T04:23:26.657688+0000","last_fullsized":"2024-09-17T04:23:26.657688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656558+0000","last_change":"2024-09-17T04:23:24.356821+0000","last_active":"2024-09-17T04:23:26.656558+0000","last_peered":"2024-09-17T04:23:26.656558+0000","last_clean":"2024-09-17T04:23:26.656558+0000","last_became_active":"2024-09-17T04:23:24.356475+0000","last_became_peered":"2024-09-17T04:23:24.356475+0000","last_unstale":"2024-09-17T04:23:26.656558+0000","last_undegraded":"2024-09-17T04:23:26.656558+0000","last_fullsized":"2024-09-17T04:23:26.656558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:42.496632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656387+0000","last_change":"2024-09-17T04:23:25.364361+0000","last_active":"2024-09-17T04:23:26.656387+0000","last_peered":"2024-09-17T04:23:26.656387+0000","last_clean":"2024-09-17T04:23:26.656387+0000","last_became_active":"2024-09-17T04:23:25.363990+0000","last_became_peered":"2024-09-17T04:23:25.363990+0000","last_unstale":"2024-09-17T04:23:26.656387+0000","last_undegraded":"2024-09-17T04:23:26.656387+0000","last_fullsized":"2024-09-17T04:23:26.656387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657778+0000","last_change":"2024-09-17T04:23:24.349646+0000","last_active":"2024-09-17T04:23:26.657778+0000","last_peered":"2024-09-17T04:23:26.657778+0000","last_clean":"2024-09-17T04:23:26.657778+0000","last_became_active":"2024-09-17T04:23:24.349309+0000","last_became_peered":"2024-09-17T04:23:24.349309+0000","last_unstale":"2024-09-17T04:23:26.657778+0000","last_undegraded":"2024-09-17T04:23:26.657778+0000","last_fullsized":"2024-09-17T04:23:26.657778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:33.135083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":200704,"data_stored":66537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:33.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:34.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.067+0000 7fb70f724640 1 -- 172.21.15.63:0/1469802704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6f4004800 msgr2=0x7fb6f4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.067+0000 7fb70f724640 1 --2- 172.21.15.63:0/1469802704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6f4004800 0x7fb6f4004c10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009d20 tx=0x7fb6f4005830 comp rx=0 tx=0).stop 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.067+0000 7fb70f724640 1 -- 172.21.15.63:0/1469802704 shutdown_connections 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.067+0000 7fb70f724640 1 --2- 172.21.15.63:0/1469802704 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6f4004800 0x7fb6f4004c10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.067+0000 7fb70f724640 1 -- 172.21.15.63:0/1469802704 >> 172.21.15.63:0/1469802704 conn(0x7fb70806def0 msgr2=0x7fb70806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.068+0000 7fb70f724640 1 -- 172.21.15.63:0/1469802704 shutdown_connections 2024-09-17T04:23:34.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.068+0000 7fb70f724640 1 -- 172.21.15.63:0/1469802704 wait complete. 2024-09-17T04:23:34.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.069+0000 7fb70f724640 1 Processor -- start 2024-09-17T04:23:34.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.069+0000 7fb70f724640 1 -- start start 2024-09-17T04:23:34.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f4004800 0x7fb708155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7081f64c0 0x7fb7081f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb70815d7c0 con 0x7fb708150f60 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb70815d640 con 0x7fb6f4004800 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70f724640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb70815d940 con 0x7fb7081f64c0 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35998/0 (socket says 172.21.15.63:35998) 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 -- 172.21.15.63:0/4072019560 learned_addr learned my addr 172.21.15.63:0/4072019560 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70d4c0640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f4004800 0x7fb708155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70dcc1640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7081f64c0 0x7fb7081f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 -- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7081f64c0 msgr2=0x7fb7081f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7081f64c0 0x7fb7081f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 -- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f4004800 msgr2=0x7fb708155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f4004800 0x7fb708155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 -- 172.21.15.63:0/4072019560 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7081532f0 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.071+0000 7fb70ccbf640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8035040 tx=0x7fb6f80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.072+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8040020 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.072+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f802ba20 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.072+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7081f72d0 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.072+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8005030 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.072+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7081538a0 con 0x7fb708150f60 2024-09-17T04:23:34.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.073+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70806cf50 con 0x7fb708150f60 2024-09-17T04:23:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.074+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6f8043020 con 0x7fb708150f60 2024-09-17T04:23:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.074+0000 7fb6fdffb640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.074+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f80bb980 con 0x7fb708150f60 2024-09-17T04:23:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.074+0000 7fb70d4c0640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.075+0000 7fb70d4c0640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb704001220 tx=0x7fb704000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.079+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6f8083770 con 0x7fb708150f60 2024-09-17T04:23:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.261+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7081597e0 con 0x7fb6ec078bc0 2024-09-17T04:23:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.266+0000 7fb6fdffb640 1 -- 172.21.15.63:0/4072019560 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251913 (secure 0 0 0) 0x7fb7081597e0 con 0x7fb6ec078bc0 2024-09-17T04:23:34.268 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 msgr2=0x7fb6ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb704001220 tx=0x7fb704000ed0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 msgr2=0x7fb708155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8035040 tx=0x7fb6f80038a0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 shutdown_connections 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6ec078bc0 0x7fb6ec07b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb7081f64c0 0x7fb7081f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb708150f60 0x7fb708155230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.269+0000 7fb70f724640 1 --2- 172.21.15.63:0/4072019560 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6f4004800 0x7fb708155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.270+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 >> 172.21.15.63:0/4072019560 conn(0x7fb70806def0 msgr2=0x7fb7080b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.270+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 shutdown_connections 2024-09-17T04:23:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.270+0000 7fb70f724640 1 -- 172.21.15.63:0/4072019560 wait complete. 2024-09-17T04:23:34.280 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T04:23:32.400099+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001788"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659274+0000","last_change":"2024-09-17T04:23:25.376557+0000","last_active":"2024-09-17T04:23:26.659274+0000","last_peered":"2024-09-17T04:23:26.659274+0000","last_clean":"2024-09-17T04:23:26.659274+0000","last_became_active":"2024-09-17T04:23:25.376196+0000","last_became_peered":"2024-09-17T04:23:25.376196+0000","last_unstale":"2024-09-17T04:23:26.659274+0000","last_undegraded":"2024-09-17T04:23:26.659274+0000","last_fullsized":"2024-09-17T04:23:26.659274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:31.126084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657398+0000","last_change":"2024-09-17T04:23:25.357621+0000","last_active":"2024-09-17T04:23:26.657398+0000","last_peered":"2024-09-17T04:23:26.657398+0000","last_clean":"2024-09-17T04:23:26.657398+0000","last_became_active":"2024-09-17T04:23:25.355965+0000","last_became_peered":"2024-09-17T04:23:25.355965+0000","last_unstale":"2024-09-17T04:23:26.657398+0000","last_undegraded":"2024-09-17T04:23:26.657398+0000","last_fullsized":"2024-09-17T04:23:26.657398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659057+0000","last_change":"2024-09-17T04:23:25.373604+0000","last_active":"2024-09-17T04:23:26.659057+0000","last_peered":"2024-09-17T04:23:26.659057+0000","last_clean":"2024-09-17T04:23:26.659057+0000","last_became_active":"2024-09-17T04:23:25.373309+0000","last_became_peered":"2024-09-17T04:23:25.373309+0000","last_unstale":"2024-09-17T04:23:26.659057+0000","last_undegraded":"2024-09-17T04:23:26.659057+0000","last_fullsized":"2024-09-17T04:23:26.659057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658926+0000","last_change":"2024-09-17T04:23:25.379332+0000","last_active":"2024-09-17T04:23:26.658926+0000","last_peered":"2024-09-17T04:23:26.658926+0000","last_clean":"2024-09-17T04:23:26.658926+0000","last_became_active":"2024-09-17T04:23:25.377519+0000","last_became_peered":"2024-09-17T04:23:25.377519+0000","last_unstale":"2024-09-17T04:23:26.658926+0000","last_undegraded":"2024-09-17T04:23:26.658926+0000","last_fullsized":"2024-09-17T04:23:26.658926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:14.203036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656178+0000","last_change":"2024-09-17T04:23:25.381475+0000","last_active":"2024-09-17T04:23:26.656178+0000","last_peered":"2024-09-17T04:23:26.656178+0000","last_clean":"2024-09-17T04:23:26.656178+0000","last_became_active":"2024-09-17T04:23:25.381163+0000","last_became_peered":"2024-09-17T04:23:25.381163+0000","last_unstale":"2024-09-17T04:23:26.656178+0000","last_undegraded":"2024-09-17T04:23:26.656178+0000","last_fullsized":"2024-09-17T04:23:26.656178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659283+0000","last_change":"2024-09-17T04:23:25.373332+0000","last_active":"2024-09-17T04:23:26.659283+0000","last_peered":"2024-09-17T04:23:26.659283+0000","last_clean":"2024-09-17T04:23:26.659283+0000","last_became_active":"2024-09-17T04:23:25.372980+0000","last_became_peered":"2024-09-17T04:23:25.372980+0000","last_unstale":"2024-09-17T04:23:26.659283+0000","last_undegraded":"2024-09-17T04:23:26.659283+0000","last_fullsized":"2024-09-17T04:23:26.659283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.403052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468977+0000","last_change":"2024-09-17T04:23:25.365489+0000","last_active":"2024-09-17T04:23:26.468977+0000","last_peered":"2024-09-17T04:23:26.468977+0000","last_clean":"2024-09-17T04:23:26.468977+0000","last_became_active":"2024-09-17T04:23:25.365166+0000","last_became_peered":"2024-09-17T04:23:25.365166+0000","last_unstale":"2024-09-17T04:23:26.468977+0000","last_undegraded":"2024-09-17T04:23:26.468977+0000","last_fullsized":"2024-09-17T04:23:26.468977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468815+0000","last_change":"2024-09-17T04:23:25.369673+0000","last_active":"2024-09-17T04:23:26.468815+0000","last_peered":"2024-09-17T04:23:26.468815+0000","last_clean":"2024-09-17T04:23:26.468815+0000","last_became_active":"2024-09-17T04:23:25.369360+0000","last_became_peered":"2024-09-17T04:23:25.369360+0000","last_unstale":"2024-09-17T04:23:26.468815+0000","last_undegraded":"2024-09-17T04:23:26.468815+0000","last_fullsized":"2024-09-17T04:23:26.468815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360528+0000","last_change":"2024-09-17T04:23:25.365165+0000","last_active":"2024-09-17T04:23:26.360528+0000","last_peered":"2024-09-17T04:23:26.360528+0000","last_clean":"2024-09-17T04:23:26.360528+0000","last_became_active":"2024-09-17T04:23:25.364840+0000","last_became_peered":"2024-09-17T04:23:25.364840+0000","last_unstale":"2024-09-17T04:23:26.360528+0000","last_undegraded":"2024-09-17T04:23:26.360528+0000","last_fullsized":"2024-09-17T04:23:26.360528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657001+0000","last_change":"2024-09-17T04:23:25.363017+0000","last_active":"2024-09-17T04:23:26.657001+0000","last_peered":"2024-09-17T04:23:26.657001+0000","last_clean":"2024-09-17T04:23:26.657001+0000","last_became_active":"2024-09-17T04:23:25.362696+0000","last_became_peered":"2024-09-17T04:23:25.362696+0000","last_unstale":"2024-09-17T04:23:26.657001+0000","last_undegraded":"2024-09-17T04:23:26.657001+0000","last_fullsized":"2024-09-17T04:23:26.657001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:29.184786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656448+0000","last_change":"2024-09-17T04:23:25.366854+0000","last_active":"2024-09-17T04:23:26.656448+0000","last_peered":"2024-09-17T04:23:26.656448+0000","last_clean":"2024-09-17T04:23:26.656448+0000","last_became_active":"2024-09-17T04:23:25.366508+0000","last_became_peered":"2024-09-17T04:23:25.366508+0000","last_unstale":"2024-09-17T04:23:26.656448+0000","last_undegraded":"2024-09-17T04:23:26.656448+0000","last_fullsized":"2024-09-17T04:23:26.656448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:55.579822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656798+0000","last_change":"2024-09-17T04:23:25.363990+0000","last_active":"2024-09-17T04:23:26.656798+0000","last_peered":"2024-09-17T04:23:26.656798+0000","last_clean":"2024-09-17T04:23:26.656798+0000","last_became_active":"2024-09-17T04:23:25.363609+0000","last_became_peered":"2024-09-17T04:23:25.363609+0000","last_unstale":"2024-09-17T04:23:26.656798+0000","last_undegraded":"2024-09-17T04:23:26.656798+0000","last_fullsized":"2024-09-17T04:23:26.656798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659347+0000","last_change":"2024-09-17T04:23:25.372922+0000","last_active":"2024-09-17T04:23:26.659347+0000","last_peered":"2024-09-17T04:23:26.659347+0000","last_clean":"2024-09-17T04:23:26.659347+0000","last_became_active":"2024-09-17T04:23:25.372597+0000","last_became_peered":"2024-09-17T04:23:25.372597+0000","last_unstale":"2024-09-17T04:23:26.659347+0000","last_undegraded":"2024-09-17T04:23:26.659347+0000","last_fullsized":"2024-09-17T04:23:26.659347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:46.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468848+0000","last_change":"2024-09-17T04:23:25.369858+0000","last_active":"2024-09-17T04:23:26.468848+0000","last_peered":"2024-09-17T04:23:26.468848+0000","last_clean":"2024-09-17T04:23:26.468848+0000","last_became_active":"2024-09-17T04:23:25.369523+0000","last_became_peered":"2024-09-17T04:23:25.369523+0000","last_unstale":"2024-09-17T04:23:26.468848+0000","last_undegraded":"2024-09-17T04:23:26.468848+0000","last_fullsized":"2024-09-17T04:23:26.468848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657526+0000","last_change":"2024-09-17T04:23:25.372496+0000","last_active":"2024-09-17T04:23:26.657526+0000","last_peered":"2024-09-17T04:23:26.657526+0000","last_clean":"2024-09-17T04:23:26.657526+0000","last_became_active":"2024-09-17T04:23:25.371988+0000","last_became_peered":"2024-09-17T04:23:25.371988+0000","last_unstale":"2024-09-17T04:23:26.657526+0000","last_undegraded":"2024-09-17T04:23:26.657526+0000","last_fullsized":"2024-09-17T04:23:26.657526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656520+0000","last_change":"2024-09-17T04:23:25.370154+0000","last_active":"2024-09-17T04:23:26.656520+0000","last_peered":"2024-09-17T04:23:26.656520+0000","last_clean":"2024-09-17T04:23:26.656520+0000","last_became_active":"2024-09-17T04:23:25.369846+0000","last_became_peered":"2024-09-17T04:23:25.369846+0000","last_unstale":"2024-09-17T04:23:26.656520+0000","last_undegraded":"2024-09-17T04:23:26.656520+0000","last_fullsized":"2024-09-17T04:23:26.656520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656790+0000","last_change":"2024-09-17T04:23:25.374875+0000","last_active":"2024-09-17T04:23:26.656790+0000","last_peered":"2024-09-17T04:23:26.656790+0000","last_clean":"2024-09-17T04:23:26.656790+0000","last_became_active":"2024-09-17T04:23:25.374565+0000","last_became_peered":"2024-09-17T04:23:25.374565+0000","last_unstale":"2024-09-17T04:23:26.656790+0000","last_undegraded":"2024-09-17T04:23:26.656790+0000","last_fullsized":"2024-09-17T04:23:26.656790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468983+0000","last_change":"2024-09-17T04:23:25.371408+0000","last_active":"2024-09-17T04:23:26.468983+0000","last_peered":"2024-09-17T04:23:26.468983+0000","last_clean":"2024-09-17T04:23:26.468983+0000","last_became_active":"2024-09-17T04:23:25.371085+0000","last_became_peered":"2024-09-17T04:23:25.371085+0000","last_unstale":"2024-09-17T04:23:26.468983+0000","last_undegraded":"2024-09-17T04:23:26.468983+0000","last_fullsized":"2024-09-17T04:23:26.468983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.992287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657086+0000","last_change":"2024-09-17T04:23:25.370366+0000","last_active":"2024-09-17T04:23:26.657086+0000","last_peered":"2024-09-17T04:23:26.657086+0000","last_clean":"2024-09-17T04:23:26.657086+0000","last_became_active":"2024-09-17T04:23:25.369986+0000","last_became_peered":"2024-09-17T04:23:25.369986+0000","last_unstale":"2024-09-17T04:23:26.657086+0000","last_undegraded":"2024-09-17T04:23:26.657086+0000","last_fullsized":"2024-09-17T04:23:26.657086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657687+0000","last_change":"2024-09-17T04:23:25.363653+0000","last_active":"2024-09-17T04:23:26.657687+0000","last_peered":"2024-09-17T04:23:26.657687+0000","last_clean":"2024-09-17T04:23:26.657687+0000","last_became_active":"2024-09-17T04:23:25.363060+0000","last_became_peered":"2024-09-17T04:23:25.363060+0000","last_unstale":"2024-09-17T04:23:26.657687+0000","last_undegraded":"2024-09-17T04:23:26.657687+0000","last_fullsized":"2024-09-17T04:23:26.657687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656912+0000","last_change":"2024-09-17T04:23:25.365226+0000","last_active":"2024-09-17T04:23:26.656912+0000","last_peered":"2024-09-17T04:23:26.656912+0000","last_clean":"2024-09-17T04:23:26.656912+0000","last_became_active":"2024-09-17T04:23:25.364858+0000","last_became_peered":"2024-09-17T04:23:25.364858+0000","last_unstale":"2024-09-17T04:23:26.656912+0000","last_undegraded":"2024-09-17T04:23:26.656912+0000","last_fullsized":"2024-09-17T04:23:26.656912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468547+0000","last_change":"2024-09-17T04:23:25.363571+0000","last_active":"2024-09-17T04:23:26.468547+0000","last_peered":"2024-09-17T04:23:26.468547+0000","last_clean":"2024-09-17T04:23:26.468547+0000","last_became_active":"2024-09-17T04:23:25.363235+0000","last_became_peered":"2024-09-17T04:23:25.363235+0000","last_unstale":"2024-09-17T04:23:26.468547+0000","last_undegraded":"2024-09-17T04:23:26.468547+0000","last_fullsized":"2024-09-17T04:23:26.468547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360260+0000","last_change":"2024-09-17T04:23:25.363674+0000","last_active":"2024-09-17T04:23:26.360260+0000","last_peered":"2024-09-17T04:23:26.360260+0000","last_clean":"2024-09-17T04:23:26.360260+0000","last_became_active":"2024-09-17T04:23:25.363334+0000","last_became_peered":"2024-09-17T04:23:25.363334+0000","last_unstale":"2024-09-17T04:23:26.360260+0000","last_undegraded":"2024-09-17T04:23:26.360260+0000","last_fullsized":"2024-09-17T04:23:26.360260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.913452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657300+0000","last_change":"2024-09-17T04:23:24.353312+0000","last_active":"2024-09-17T04:23:26.657300+0000","last_peered":"2024-09-17T04:23:26.657300+0000","last_clean":"2024-09-17T04:23:26.657300+0000","last_became_active":"2024-09-17T04:23:24.352973+0000","last_became_peered":"2024-09-17T04:23:24.352973+0000","last_unstale":"2024-09-17T04:23:26.657300+0000","last_undegraded":"2024-09-17T04:23:26.657300+0000","last_fullsized":"2024-09-17T04:23:26.657300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:00.251669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657690+0000","last_change":"2024-09-17T04:23:25.367192+0000","last_active":"2024-09-17T04:23:26.657690+0000","last_peered":"2024-09-17T04:23:26.657690+0000","last_clean":"2024-09-17T04:23:26.657690+0000","last_became_active":"2024-09-17T04:23:25.366787+0000","last_became_peered":"2024-09-17T04:23:25.366787+0000","last_unstale":"2024-09-17T04:23:26.657690+0000","last_undegraded":"2024-09-17T04:23:26.657690+0000","last_fullsized":"2024-09-17T04:23:26.657690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468424+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.468424+0000","last_peered":"2024-09-17T04:23:26.468424+0000","last_clean":"2024-09-17T04:23:26.468424+0000","last_became_active":"2024-09-17T04:23:24.353296+0000","last_became_peered":"2024-09-17T04:23:24.353296+0000","last_unstale":"2024-09-17T04:23:26.468424+0000","last_undegraded":"2024-09-17T04:23:26.468424+0000","last_fullsized":"2024-09-17T04:23:26.468424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656443+0000","last_change":"2024-09-17T04:23:24.354209+0000","last_active":"2024-09-17T04:23:26.656443+0000","last_peered":"2024-09-17T04:23:26.656443+0000","last_clean":"2024-09-17T04:23:26.656443+0000","last_became_active":"2024-09-17T04:23:24.353857+0000","last_became_peered":"2024-09-17T04:23:24.353857+0000","last_unstale":"2024-09-17T04:23:26.656443+0000","last_undegraded":"2024-09-17T04:23:26.656443+0000","last_fullsized":"2024-09-17T04:23:26.656443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656651+0000","last_change":"2024-09-17T04:23:25.367243+0000","last_active":"2024-09-17T04:23:26.656651+0000","last_peered":"2024-09-17T04:23:26.656651+0000","last_clean":"2024-09-17T04:23:26.656651+0000","last_became_active":"2024-09-17T04:23:25.366397+0000","last_became_peered":"2024-09-17T04:23:25.366397+0000","last_unstale":"2024-09-17T04:23:26.656651+0000","last_undegraded":"2024-09-17T04:23:26.656651+0000","last_fullsized":"2024-09-17T04:23:26.656651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468794+0000","last_change":"2024-09-17T04:23:24.352132+0000","last_active":"2024-09-17T04:23:26.468794+0000","last_peered":"2024-09-17T04:23:26.468794+0000","last_clean":"2024-09-17T04:23:26.468794+0000","last_became_active":"2024-09-17T04:23:24.351783+0000","last_became_peered":"2024-09-17T04:23:24.351783+0000","last_unstale":"2024-09-17T04:23:26.468794+0000","last_undegraded":"2024-09-17T04:23:26.468794+0000","last_fullsized":"2024-09-17T04:23:26.468794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657677+0000","last_change":"2024-09-17T04:23:25.357396+0000","last_active":"2024-09-17T04:23:26.657677+0000","last_peered":"2024-09-17T04:23:26.657677+0000","last_clean":"2024-09-17T04:23:26.657677+0000","last_became_active":"2024-09-17T04:23:25.357068+0000","last_became_peered":"2024-09-17T04:23:25.357068+0000","last_unstale":"2024-09-17T04:23:26.657677+0000","last_undegraded":"2024-09-17T04:23:26.657677+0000","last_fullsized":"2024-09-17T04:23:26.657677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360646+0000","last_change":"2024-09-17T04:23:25.373865+0000","last_active":"2024-09-17T04:23:26.360646+0000","last_peered":"2024-09-17T04:23:26.360646+0000","last_clean":"2024-09-17T04:23:26.360646+0000","last_became_active":"2024-09-17T04:23:25.373552+0000","last_became_peered":"2024-09-17T04:23:25.373552+0000","last_unstale":"2024-09-17T04:23:26.360646+0000","last_undegraded":"2024-09-17T04:23:26.360646+0000","last_fullsized":"2024-09-17T04:23:26.360646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.547724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468703+0000","last_change":"2024-09-17T04:23:24.356471+0000","last_active":"2024-09-17T04:23:26.468703+0000","last_peered":"2024-09-17T04:23:26.468703+0000","last_clean":"2024-09-17T04:23:26.468703+0000","last_became_active":"2024-09-17T04:23:24.356116+0000","last_became_peered":"2024-09-17T04:23:24.356116+0000","last_unstale":"2024-09-17T04:23:26.468703+0000","last_undegraded":"2024-09-17T04:23:26.468703+0000","last_fullsized":"2024-09-17T04:23:26.468703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659061+0000","last_change":"2024-09-17T04:23:25.375376+0000","last_active":"2024-09-17T04:23:26.659061+0000","last_peered":"2024-09-17T04:23:26.659061+0000","last_clean":"2024-09-17T04:23:26.659061+0000","last_became_active":"2024-09-17T04:23:25.375049+0000","last_became_peered":"2024-09-17T04:23:25.375049+0000","last_unstale":"2024-09-17T04:23:26.659061+0000","last_undegraded":"2024-09-17T04:23:26.659061+0000","last_fullsized":"2024-09-17T04:23:26.659061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:37.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657777+0000","last_change":"2024-09-17T04:23:24.343096+0000","last_active":"2024-09-17T04:23:26.657777+0000","last_peered":"2024-09-17T04:23:26.657777+0000","last_clean":"2024-09-17T04:23:26.657777+0000","last_became_active":"2024-09-17T04:23:24.340534+0000","last_became_peered":"2024-09-17T04:23:24.340534+0000","last_unstale":"2024-09-17T04:23:26.657777+0000","last_undegraded":"2024-09-17T04:23:26.657777+0000","last_fullsized":"2024-09-17T04:23:26.657777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656521+0000","last_change":"2024-09-17T04:23:25.372210+0000","last_active":"2024-09-17T04:23:26.656521+0000","last_peered":"2024-09-17T04:23:26.656521+0000","last_clean":"2024-09-17T04:23:26.656521+0000","last_became_active":"2024-09-17T04:23:25.371825+0000","last_became_peered":"2024-09-17T04:23:25.371825+0000","last_unstale":"2024-09-17T04:23:26.656521+0000","last_undegraded":"2024-09-17T04:23:26.656521+0000","last_fullsized":"2024-09-17T04:23:26.656521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:26.115764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659095+0000","last_change":"2024-09-17T04:23:25.381294+0000","last_active":"2024-09-17T04:23:26.659095+0000","last_peered":"2024-09-17T04:23:26.659095+0000","last_clean":"2024-09-17T04:23:26.659095+0000","last_became_active":"2024-09-17T04:23:25.379816+0000","last_became_peered":"2024-09-17T04:23:25.379816+0000","last_unstale":"2024-09-17T04:23:26.659095+0000","last_undegraded":"2024-09-17T04:23:26.659095+0000","last_fullsized":"2024-09-17T04:23:26.659095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:18.964734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468364+0000","last_change":"2024-09-17T04:23:24.352552+0000","last_active":"2024-09-17T04:23:26.468364+0000","last_peered":"2024-09-17T04:23:26.468364+0000","last_clean":"2024-09-17T04:23:26.468364+0000","last_became_active":"2024-09-17T04:23:24.352220+0000","last_became_peered":"2024-09-17T04:23:24.352220+0000","last_unstale":"2024-09-17T04:23:26.468364+0000","last_undegraded":"2024-09-17T04:23:26.468364+0000","last_fullsized":"2024-09-17T04:23:26.468364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468554+0000","last_change":"2024-09-17T04:23:25.367603+0000","last_active":"2024-09-17T04:23:26.468554+0000","last_peered":"2024-09-17T04:23:26.468554+0000","last_clean":"2024-09-17T04:23:26.468554+0000","last_became_active":"2024-09-17T04:23:25.367219+0000","last_became_peered":"2024-09-17T04:23:25.367219+0000","last_unstale":"2024-09-17T04:23:26.468554+0000","last_undegraded":"2024-09-17T04:23:26.468554+0000","last_fullsized":"2024-09-17T04:23:26.468554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:09.908355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656699+0000","last_change":"2024-09-17T04:23:24.354050+0000","last_active":"2024-09-17T04:23:26.656699+0000","last_peered":"2024-09-17T04:23:26.656699+0000","last_clean":"2024-09-17T04:23:26.656699+0000","last_became_active":"2024-09-17T04:23:24.353683+0000","last_became_peered":"2024-09-17T04:23:24.353683+0000","last_unstale":"2024-09-17T04:23:26.656699+0000","last_undegraded":"2024-09-17T04:23:26.656699+0000","last_fullsized":"2024-09-17T04:23:26.656699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:04.191476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658744+0000","last_change":"2024-09-17T04:23:25.376511+0000","last_active":"2024-09-17T04:23:26.658744+0000","last_peered":"2024-09-17T04:23:26.658744+0000","last_clean":"2024-09-17T04:23:26.658744+0000","last_became_active":"2024-09-17T04:23:25.376218+0000","last_became_peered":"2024-09-17T04:23:25.376218+0000","last_unstale":"2024-09-17T04:23:26.658744+0000","last_undegraded":"2024-09-17T04:23:26.658744+0000","last_fullsized":"2024-09-17T04:23:26.658744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:59.631965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360742+0000","last_change":"2024-09-17T04:23:24.339532+0000","last_active":"2024-09-17T04:23:26.360742+0000","last_peered":"2024-09-17T04:23:26.360742+0000","last_clean":"2024-09-17T04:23:26.360742+0000","last_became_active":"2024-09-17T04:23:24.338952+0000","last_became_peered":"2024-09-17T04:23:24.338952+0000","last_unstale":"2024-09-17T04:23:26.360742+0000","last_undegraded":"2024-09-17T04:23:26.360742+0000","last_fullsized":"2024-09-17T04:23:26.360742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:07.931802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659183+0000","last_change":"2024-09-17T04:23:25.378130+0000","last_active":"2024-09-17T04:23:26.659183+0000","last_peered":"2024-09-17T04:23:26.659183+0000","last_clean":"2024-09-17T04:23:26.659183+0000","last_became_active":"2024-09-17T04:23:25.377278+0000","last_became_peered":"2024-09-17T04:23:25.377278+0000","last_unstale":"2024-09-17T04:23:26.659183+0000","last_undegraded":"2024-09-17T04:23:26.659183+0000","last_fullsized":"2024-09-17T04:23:26.659183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.934488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656882+0000","last_change":"2024-09-17T04:23:24.354131+0000","last_active":"2024-09-17T04:23:26.656882+0000","last_peered":"2024-09-17T04:23:26.656882+0000","last_clean":"2024-09-17T04:23:26.656882+0000","last_became_active":"2024-09-17T04:23:24.353777+0000","last_became_peered":"2024-09-17T04:23:24.353777+0000","last_unstale":"2024-09-17T04:23:26.656882+0000","last_undegraded":"2024-09-17T04:23:26.656882+0000","last_fullsized":"2024-09-17T04:23:26.656882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659540+0000","last_change":"2024-09-17T04:23:25.379331+0000","last_active":"2024-09-17T04:23:26.659540+0000","last_peered":"2024-09-17T04:23:26.659540+0000","last_clean":"2024-09-17T04:23:26.659540+0000","last_became_active":"2024-09-17T04:23:25.377494+0000","last_became_peered":"2024-09-17T04:23:25.377494+0000","last_unstale":"2024-09-17T04:23:26.659540+0000","last_undegraded":"2024-09-17T04:23:26.659540+0000","last_fullsized":"2024-09-17T04:23:26.659540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:10.116857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656281+0000","last_change":"2024-09-17T04:23:24.349655+0000","last_active":"2024-09-17T04:23:26.656281+0000","last_peered":"2024-09-17T04:23:26.656281+0000","last_clean":"2024-09-17T04:23:26.656281+0000","last_became_active":"2024-09-17T04:23:24.349349+0000","last_became_peered":"2024-09-17T04:23:24.349349+0000","last_unstale":"2024-09-17T04:23:26.656281+0000","last_undegraded":"2024-09-17T04:23:26.656281+0000","last_fullsized":"2024-09-17T04:23:26.656281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:04.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659133+0000","last_change":"2024-09-17T04:23:25.380320+0000","last_active":"2024-09-17T04:23:26.659133+0000","last_peered":"2024-09-17T04:23:26.659133+0000","last_clean":"2024-09-17T04:23:26.659133+0000","last_became_active":"2024-09-17T04:23:25.379951+0000","last_became_peered":"2024-09-17T04:23:25.379951+0000","last_unstale":"2024-09-17T04:23:26.659133+0000","last_undegraded":"2024-09-17T04:23:26.659133+0000","last_fullsized":"2024-09-17T04:23:26.659133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:23.089918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658756+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:26.658756+0000","last_peered":"2024-09-17T04:23:26.658756+0000","last_clean":"2024-09-17T04:23:26.658756+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:26.658756+0000","last_undegraded":"2024-09-17T04:23:26.658756+0000","last_fullsized":"2024-09-17T04:23:26.658756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656250+0000","last_change":"2024-09-17T04:23:25.381586+0000","last_active":"2024-09-17T04:23:26.656250+0000","last_peered":"2024-09-17T04:23:26.656250+0000","last_clean":"2024-09-17T04:23:26.656250+0000","last_became_active":"2024-09-17T04:23:25.381261+0000","last_became_peered":"2024-09-17T04:23:25.381261+0000","last_unstale":"2024-09-17T04:23:26.656250+0000","last_undegraded":"2024-09-17T04:23:26.656250+0000","last_fullsized":"2024-09-17T04:23:26.656250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658502+0000","last_change":"2024-09-17T04:23:24.356897+0000","last_active":"2024-09-17T04:23:26.658502+0000","last_peered":"2024-09-17T04:23:26.658502+0000","last_clean":"2024-09-17T04:23:26.658502+0000","last_became_active":"2024-09-17T04:23:24.356553+0000","last_became_peered":"2024-09-17T04:23:24.356553+0000","last_unstale":"2024-09-17T04:23:26.658502+0000","last_undegraded":"2024-09-17T04:23:26.658502+0000","last_fullsized":"2024-09-17T04:23:26.658502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656883+0000","last_change":"2024-09-17T04:23:25.356801+0000","last_active":"2024-09-17T04:23:26.656883+0000","last_peered":"2024-09-17T04:23:26.656883+0000","last_clean":"2024-09-17T04:23:26.656883+0000","last_became_active":"2024-09-17T04:23:25.356450+0000","last_became_peered":"2024-09-17T04:23:25.356450+0000","last_unstale":"2024-09-17T04:23:26.656883+0000","last_undegraded":"2024-09-17T04:23:26.656883+0000","last_fullsized":"2024-09-17T04:23:26.656883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:30.495912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657024+0000","last_change":"2024-09-17T04:23:24.353192+0000","last_active":"2024-09-17T04:23:26.657024+0000","last_peered":"2024-09-17T04:23:26.657024+0000","last_clean":"2024-09-17T04:23:26.657024+0000","last_became_active":"2024-09-17T04:23:24.352863+0000","last_became_peered":"2024-09-17T04:23:24.352863+0000","last_unstale":"2024-09-17T04:23:26.657024+0000","last_undegraded":"2024-09-17T04:23:26.657024+0000","last_fullsized":"2024-09-17T04:23:26.657024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360605+0000","last_change":"2024-09-17T04:23:25.362549+0000","last_active":"2024-09-17T04:23:26.360605+0000","last_peered":"2024-09-17T04:23:26.360605+0000","last_clean":"2024-09-17T04:23:26.360605+0000","last_became_active":"2024-09-17T04:23:25.362227+0000","last_became_peered":"2024-09-17T04:23:25.362227+0000","last_unstale":"2024-09-17T04:23:26.360605+0000","last_undegraded":"2024-09-17T04:23:26.360605+0000","last_fullsized":"2024-09-17T04:23:26.360605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659359+0000","last_change":"2024-09-17T04:23:24.354097+0000","last_active":"2024-09-17T04:23:26.659359+0000","last_peered":"2024-09-17T04:23:26.659359+0000","last_clean":"2024-09-17T04:23:26.659359+0000","last_became_active":"2024-09-17T04:23:24.353583+0000","last_became_peered":"2024-09-17T04:23:24.353583+0000","last_unstale":"2024-09-17T04:23:26.659359+0000","last_undegraded":"2024-09-17T04:23:26.659359+0000","last_fullsized":"2024-09-17T04:23:26.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.874215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:27.053904+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:27.053904+0000","last_peered":"2024-09-17T04:23:27.053904+0000","last_clean":"2024-09-17T04:23:27.053904+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:27.053904+0000","last_undegraded":"2024-09-17T04:23:27.053904+0000","last_fullsized":"2024-09-17T04:23:27.053904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656641+0000","last_change":"2024-09-17T04:23:25.370909+0000","last_active":"2024-09-17T04:23:26.656641+0000","last_peered":"2024-09-17T04:23:26.656641+0000","last_clean":"2024-09-17T04:23:26.656641+0000","last_became_active":"2024-09-17T04:23:25.370575+0000","last_became_peered":"2024-09-17T04:23:25.370575+0000","last_unstale":"2024-09-17T04:23:26.656641+0000","last_undegraded":"2024-09-17T04:23:26.656641+0000","last_fullsized":"2024-09-17T04:23:26.656641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468856+0000","last_change":"2024-09-17T04:23:24.350404+0000","last_active":"2024-09-17T04:23:26.468856+0000","last_peered":"2024-09-17T04:23:26.468856+0000","last_clean":"2024-09-17T04:23:26.468856+0000","last_became_active":"2024-09-17T04:23:24.349057+0000","last_became_peered":"2024-09-17T04:23:24.349057+0000","last_unstale":"2024-09-17T04:23:26.468856+0000","last_undegraded":"2024-09-17T04:23:26.468856+0000","last_fullsized":"2024-09-17T04:23:26.468856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657233+0000","last_change":"2024-09-17T04:23:25.356958+0000","last_active":"2024-09-17T04:23:26.657233+0000","last_peered":"2024-09-17T04:23:26.657233+0000","last_clean":"2024-09-17T04:23:26.657233+0000","last_became_active":"2024-09-17T04:23:25.356609+0000","last_became_peered":"2024-09-17T04:23:25.356609+0000","last_unstale":"2024-09-17T04:23:26.657233+0000","last_undegraded":"2024-09-17T04:23:26.657233+0000","last_fullsized":"2024-09-17T04:23:26.657233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658663+0000","last_change":"2024-09-17T04:23:24.354084+0000","last_active":"2024-09-17T04:23:26.658663+0000","last_peered":"2024-09-17T04:23:26.658663+0000","last_clean":"2024-09-17T04:23:26.658663+0000","last_became_active":"2024-09-17T04:23:24.353744+0000","last_became_peered":"2024-09-17T04:23:24.353744+0000","last_unstale":"2024-09-17T04:23:26.658663+0000","last_undegraded":"2024-09-17T04:23:26.658663+0000","last_fullsized":"2024-09-17T04:23:26.658663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360379+0000","last_change":"2024-09-17T04:23:25.356709+0000","last_active":"2024-09-17T04:23:26.360379+0000","last_peered":"2024-09-17T04:23:26.360379+0000","last_clean":"2024-09-17T04:23:26.360379+0000","last_became_active":"2024-09-17T04:23:25.356403+0000","last_became_peered":"2024-09-17T04:23:25.356403+0000","last_unstale":"2024-09-17T04:23:26.360379+0000","last_undegraded":"2024-09-17T04:23:26.360379+0000","last_fullsized":"2024-09-17T04:23:26.360379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:49.386382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656896+0000","last_change":"2024-09-17T04:23:25.367584+0000","last_active":"2024-09-17T04:23:26.656896+0000","last_peered":"2024-09-17T04:23:26.656896+0000","last_clean":"2024-09-17T04:23:26.656896+0000","last_became_active":"2024-09-17T04:23:25.366943+0000","last_became_peered":"2024-09-17T04:23:25.366943+0000","last_unstale":"2024-09-17T04:23:26.656896+0000","last_undegraded":"2024-09-17T04:23:26.656896+0000","last_fullsized":"2024-09-17T04:23:26.656896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657231+0000","last_change":"2024-09-17T04:23:25.366947+0000","last_active":"2024-09-17T04:23:26.657231+0000","last_peered":"2024-09-17T04:23:26.657231+0000","last_clean":"2024-09-17T04:23:26.657231+0000","last_became_active":"2024-09-17T04:23:25.366593+0000","last_became_peered":"2024-09-17T04:23:25.366593+0000","last_unstale":"2024-09-17T04:23:26.657231+0000","last_undegraded":"2024-09-17T04:23:26.657231+0000","last_fullsized":"2024-09-17T04:23:26.657231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.638076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659143+0000","last_change":"2024-09-17T04:23:24.351819+0000","last_active":"2024-09-17T04:23:26.659143+0000","last_peered":"2024-09-17T04:23:26.659143+0000","last_clean":"2024-09-17T04:23:26.659143+0000","last_became_active":"2024-09-17T04:23:24.351483+0000","last_became_peered":"2024-09-17T04:23:24.351483+0000","last_unstale":"2024-09-17T04:23:26.659143+0000","last_undegraded":"2024-09-17T04:23:26.659143+0000","last_fullsized":"2024-09-17T04:23:26.659143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:18.736197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468638+0000","last_change":"2024-09-17T04:23:25.369382+0000","last_active":"2024-09-17T04:23:26.468638+0000","last_peered":"2024-09-17T04:23:26.468638+0000","last_clean":"2024-09-17T04:23:26.468638+0000","last_became_active":"2024-09-17T04:23:25.369026+0000","last_became_peered":"2024-09-17T04:23:25.369026+0000","last_unstale":"2024-09-17T04:23:26.468638+0000","last_undegraded":"2024-09-17T04:23:26.468638+0000","last_fullsized":"2024-09-17T04:23:26.468638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658625+0000","last_change":"2024-09-17T04:23:24.349161+0000","last_active":"2024-09-17T04:23:26.658625+0000","last_peered":"2024-09-17T04:23:26.658625+0000","last_clean":"2024-09-17T04:23:26.658625+0000","last_became_active":"2024-09-17T04:23:24.348825+0000","last_became_peered":"2024-09-17T04:23:24.348825+0000","last_unstale":"2024-09-17T04:23:26.658625+0000","last_undegraded":"2024-09-17T04:23:26.658625+0000","last_fullsized":"2024-09-17T04:23:26.658625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.666124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659219+0000","last_change":"2024-09-17T04:23:24.353160+0000","last_active":"2024-09-17T04:23:26.659219+0000","last_peered":"2024-09-17T04:23:26.659219+0000","last_clean":"2024-09-17T04:23:26.659219+0000","last_became_active":"2024-09-17T04:23:24.352829+0000","last_became_peered":"2024-09-17T04:23:24.352829+0000","last_unstale":"2024-09-17T04:23:26.659219+0000","last_undegraded":"2024-09-17T04:23:26.659219+0000","last_fullsized":"2024-09-17T04:23:26.659219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657688+0000","last_change":"2024-09-17T04:23:25.370271+0000","last_active":"2024-09-17T04:23:26.657688+0000","last_peered":"2024-09-17T04:23:26.657688+0000","last_clean":"2024-09-17T04:23:26.657688+0000","last_became_active":"2024-09-17T04:23:25.369591+0000","last_became_peered":"2024-09-17T04:23:25.369591+0000","last_unstale":"2024-09-17T04:23:26.657688+0000","last_undegraded":"2024-09-17T04:23:26.657688+0000","last_fullsized":"2024-09-17T04:23:26.657688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656558+0000","last_change":"2024-09-17T04:23:24.356821+0000","last_active":"2024-09-17T04:23:26.656558+0000","last_peered":"2024-09-17T04:23:26.656558+0000","last_clean":"2024-09-17T04:23:26.656558+0000","last_became_active":"2024-09-17T04:23:24.356475+0000","last_became_peered":"2024-09-17T04:23:24.356475+0000","last_unstale":"2024-09-17T04:23:26.656558+0000","last_undegraded":"2024-09-17T04:23:26.656558+0000","last_fullsized":"2024-09-17T04:23:26.656558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:42.496632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656387+0000","last_change":"2024-09-17T04:23:25.364361+0000","last_active":"2024-09-17T04:23:26.656387+0000","last_peered":"2024-09-17T04:23:26.656387+0000","last_clean":"2024-09-17T04:23:26.656387+0000","last_became_active":"2024-09-17T04:23:25.363990+0000","last_became_peered":"2024-09-17T04:23:25.363990+0000","last_unstale":"2024-09-17T04:23:26.656387+0000","last_undegraded":"2024-09-17T04:23:26.656387+0000","last_fullsized":"2024-09-17T04:23:26.656387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657778+0000","last_change":"2024-09-17T04:23:24.349646+0000","last_active":"2024-09-17T04:23:26.657778+0000","last_peered":"2024-09-17T04:23:26.657778+0000","last_clean":"2024-09-17T04:23:26.657778+0000","last_became_active":"2024-09-17T04:23:24.349309+0000","last_became_peered":"2024-09-17T04:23:24.349309+0000","last_unstale":"2024-09-17T04:23:26.657778+0000","last_undegraded":"2024-09-17T04:23:26.657778+0000","last_fullsized":"2024-09-17T04:23:26.657778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:33.135083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:34.284 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:23:34.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T04:23:34.285 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T04:23:34.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 -- 172.21.15.63:0/3786311638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340d3870 msgr2=0x7f80340ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 --2- 172.21.15.63:0/3786311638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340d3870 0x7f80340ceb40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f80340b70e0 tx=0x7f802c02a9c0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 -- 172.21.15.63:0/3786311638 shutdown_connections 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 --2- 172.21.15.63:0/3786311638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340d3870 0x7f80340ceb40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 --2- 172.21.15.63:0/3786311638 >> v2:172.21.15.112:3300/0 conn(0x7f803406f4b0 0x7f80340d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 --2- 172.21.15.63:0/3786311638 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f803406e170 0x7f80340b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 -- 172.21.15.63:0/3786311638 >> 172.21.15.63:0/3786311638 conn(0x7f803408bfc0 msgr2=0x7f803409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 -- 172.21.15.63:0/3786311638 shutdown_connections 2024-09-17T04:23:34.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.439+0000 7f803a030640 1 -- 172.21.15.63:0/3786311638 wait complete. 2024-09-17T04:23:34.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.441+0000 7f803a030640 1 Processor -- start 2024-09-17T04:23:34.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.441+0000 7f803a030640 1 -- start start 2024-09-17T04:23:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 0x7f80341f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 0x7f803415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f80340cf490 con 0x7f80340cabb0 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f80340cf310 con 0x7f803406f4b0 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.442+0000 7f803a030640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f80340d0ce0 con 0x7f80340d3870 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36030/0 (socket says 172.21.15.63:36030) 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 -- 172.21.15.63:0/2398634955 learned_addr learned my addr 172.21.15.63:0/2398634955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8032ffd640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 0x7f803415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f80337fe640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 0x7f80341f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 -- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 msgr2=0x7f803415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 0x7f803415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 -- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 msgr2=0x7f80341f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 0x7f80341f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 -- 172.21.15.63:0/2398634955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80340cb250 con 0x7f80340cabb0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8032ffd640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 0x7f803415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f80337fe640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 0x7f80341f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f8033fff640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f802c033040 tx=0x7f802c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c034040 con 0x7f80340cabb0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80341f6790 con 0x7f80340cabb0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f802c004540 con 0x7f80340cabb0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c045480 con 0x7f80340cabb0 2024-09-17T04:23:34.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.443+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80341f82f0 con 0x7f80340cabb0 2024-09-17T04:23:34.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.445+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034069590 con 0x7f80340cabb0 2024-09-17T04:23:34.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.445+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f802c037020 con 0x7f80340cabb0 2024-09-17T04:23:34.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.445+0000 7f801bfff640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 0x7f802007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.446+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f802c0bc650 con 0x7f80340cabb0 2024-09-17T04:23:34.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.446+0000 7f80337fe640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 0x7f802007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.446+0000 7f80337fe640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 0x7f802007b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8024009aa0 tx=0x7f8024005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.450+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8034069590 con 0x7f80340cabb0 2024-09-17T04:23:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.635+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f80340cafe0 con 0x7f80340cabb0 2024-09-17T04:23:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.635+0000 7f801bfff640 1 -- 172.21.15.63:0/2398634955 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f802c084a10 con 0x7f80340cabb0 2024-09-17T04:23:34.635 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.637+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 msgr2=0x7f802007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.637+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 0x7f802007b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8024009aa0 tx=0x7f8024005db0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.637+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 msgr2=0x7f80340c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.637+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f802c033040 tx=0x7f802c003f70 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 shutdown_connections 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8020078bc0 0x7f802007b0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80340cabb0 0x7f80340c8a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f80340d3870 0x7f803415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 --2- 172.21.15.63:0/2398634955 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f803406f4b0 0x7f80341f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 >> 172.21.15.63:0/2398634955 conn(0x7f803408bfc0 msgr2=0x7f8034068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 shutdown_connections 2024-09-17T04:23:34.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.638+0000 7f803a030640 1 -- 172.21.15.63:0/2398634955 wait complete. 2024-09-17T04:23:34.648 INFO:teuthology.orchestra.run.smithi063.stdout:[{"version":31,"timestamp":"2024-09-17T04:23:12.882384+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"4408.520586"}]}] 2024-09-17T04:23:34.649 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T04:23:34.649 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T04:23:34.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T04:23:34.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 -- 172.21.15.63:0/2474475161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200d1490 msgr2=0x7fae200cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 --2- 172.21.15.63:0/2474475161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200d1490 0x7fae200cebf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae20073f50 tx=0x7fae1802aac0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 -- 172.21.15.63:0/2474475161 shutdown_connections 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 --2- 172.21.15.63:0/2474475161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200d1490 0x7fae200cebf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 --2- 172.21.15.63:0/2474475161 >> v2:172.21.15.112:3300/0 conn(0x7fae200b51c0 0x7fae2015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 -- 172.21.15.63:0/2474475161 >> 172.21.15.63:0/2474475161 conn(0x7fae20072ae0 msgr2=0x7fae20072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 -- 172.21.15.63:0/2474475161 shutdown_connections 2024-09-17T04:23:34.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.766+0000 7fae26d2b640 1 -- 172.21.15.63:0/2474475161 wait complete. 2024-09-17T04:23:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.767+0000 7fae26d2b640 1 Processor -- start 2024-09-17T04:23:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.768+0000 7fae26d2b640 1 -- start start 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae200ccbd0 0x7fae20147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae200d1490 0x7fae20158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fae200cf2b0 con 0x7fae200b51c0 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fae200cf130 con 0x7fae200d1490 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae26d2b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fae200cf430 con 0x7fae200ccbd0 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36046/0 (socket says 172.21.15.63:36046) 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 -- 172.21.15.63:0/1674610056 learned_addr learned my addr 172.21.15.63:0/1674610056 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae1ffff640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae200ccbd0 0x7fae20147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae252c8640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae200d1490 0x7fae20158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 -- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae200ccbd0 msgr2=0x7fae20147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae200ccbd0 0x7fae20147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 -- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae200d1490 msgr2=0x7fae20158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae200d1490 0x7fae20158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.769+0000 7fae24ac7640 1 -- 172.21.15.63:0/1674610056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae200ca960 con 0x7fae200b51c0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae24ac7640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae1400e790 tx=0x7fae1400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1400eea0 con 0x7fae200b51c0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae1400cdb0 con 0x7fae200b51c0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae200cac40 con 0x7fae200b51c0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14010690 con 0x7fae200b51c0 2024-09-17T04:23:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.770+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae200cb200 con 0x7fae200b51c0 2024-09-17T04:23:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.771+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae200cf8e0 con 0x7fae200b51c0 2024-09-17T04:23:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.772+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae14010830 con 0x7fae200b51c0 2024-09-17T04:23:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.772+0000 7fae1d7fa640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 0x7fae0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.773+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae1409b690 con 0x7fae200b51c0 2024-09-17T04:23:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.773+0000 7fae1ffff640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 0x7fae0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:34.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.773+0000 7fae1ffff640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 0x7fae0407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae200c8600 tx=0x7fae0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:34.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:34.777+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae14063480 con 0x7fae200b51c0 2024-09-17T04:23:35.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.016+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fae2015ba80 con 0x7fae200b51c0 2024-09-17T04:23:35.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.019+0000 7fae1d7fa640 1 -- 172.21.15.63:0/1674610056 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194718 (secure 0 0 0) 0x7fae14067eb0 con 0x7fae200b51c0 2024-09-17T04:23:35.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:35.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 msgr2=0x7fae0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 0x7fae0407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae200c8600 tx=0x7fae0c009040 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 msgr2=0x7fae20147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae1400e790 tx=0x7fae1400ec50 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 shutdown_connections 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fae04078b90 0x7fae0407b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fae200d1490 0x7fae20158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fae200ccbd0 0x7fae20147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 --2- 172.21.15.63:0/1674610056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae200b51c0 0x7fae20147ab0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 >> 172.21.15.63:0/1674610056 conn(0x7fae20072ae0 msgr2=0x7fae200d1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 shutdown_connections 2024-09-17T04:23:35.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.022+0000 7fae26d2b640 1 -- 172.21.15.63:0/1674610056 wait complete. 2024-09-17T04:23:35.033 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":915738559},{"type":"v1","addr":"172.21.15.112:6801","nonce":915738559}]},"active_addr":"172.21.15.112:6801/915738559","active_change":"2024-09-17T04:23:04.390222+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2598494910}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2065918636}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":688951550}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2063747329}]}]} 2024-09-17T04:23:35.037 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T04:23:35.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T04:23:35.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 -- 172.21.15.63:0/1429387792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806f6e0 msgr2=0x7fea7806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 --2- 172.21.15.63:0/1429387792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806f6e0 0x7fea7806e610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea7808d490 tx=0x7fea7402a8f0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 -- 172.21.15.63:0/1429387792 shutdown_connections 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 --2- 172.21.15.63:0/1429387792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806f6e0 0x7fea7806e610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 --2- 172.21.15.63:0/1429387792 >> v2:172.21.15.112:3300/0 conn(0x7fea7806e0a0 0x7fea780b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 -- 172.21.15.63:0/1429387792 >> 172.21.15.63:0/1429387792 conn(0x7fea7809d840 msgr2=0x7fea7808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 -- 172.21.15.63:0/1429387792 shutdown_connections 2024-09-17T04:23:35.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.154+0000 7fea7fc56640 1 -- 172.21.15.63:0/1429387792 wait complete. 2024-09-17T04:23:35.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.156+0000 7fea7fc56640 1 Processor -- start 2024-09-17T04:23:35.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.156+0000 7fea7fc56640 1 -- start start 2024-09-17T04:23:35.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea7806f6e0 0x7fea78154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea780d0e50 0x7fea78154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea780cfea0 con 0x7fea7806e0a0 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fea780cfd20 con 0x7fea780d0e50 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7fc56640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fea780d0020 con 0x7fea7806f6e0 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36060/0 (socket says 172.21.15.63:36060) 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 -- 172.21.15.63:0/3970678307 learned_addr learned my addr 172.21.15.63:0/3970678307 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7e1f3640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea780d0e50 0x7fea78154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d1f1640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea7806f6e0 0x7fea78154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 -- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea7806f6e0 msgr2=0x7fea78154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea7806f6e0 0x7fea78154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 -- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea780d0e50 msgr2=0x7fea78154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea780d0e50 0x7fea78154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.157+0000 7fea7d9f2640 1 -- 172.21.15.63:0/3970678307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea78155f30 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea7d9f2640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00d720 tx=0x7fea6c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c017070 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea6c009b30 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea781563b0 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c010460 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.158+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea78156970 con 0x7fea7806e0a0 2024-09-17T04:23:35.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.159+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea780d0460 con 0x7fea7806e0a0 2024-09-17T04:23:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.160+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea6c01a070 con 0x7fea7806e0a0 2024-09-17T04:23:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.160+0000 7fea6a7fc640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 0x7fea5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.160+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fea6c09ada0 con 0x7fea7806e0a0 2024-09-17T04:23:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.160+0000 7fea7d1f1640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 0x7fea5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.161+0000 7fea7d1f1640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 0x7fea5c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea74035000 tx=0x7fea74004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.165+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea6c062c20 con 0x7fea7806e0a0 2024-09-17T04:23:35.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.348+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea780cf3a0 con 0x7fea7806e0a0 2024-09-17T04:23:35.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.349+0000 7fea6a7fc640 1 -- 172.21.15.63:0/3970678307 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7fea6c067650 con 0x7fea7806e0a0 2024-09-17T04:23:35.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:35.350 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:35.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 msgr2=0x7fea5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 0x7fea5c07b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea74035000 tx=0x7fea74004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 msgr2=0x7fea781559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00d720 tx=0x7fea6c00dbe0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 shutdown_connections 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fea5c078b90 0x7fea5c07b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fea780d0e50 0x7fea78154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fea7806f6e0 0x7fea78154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.351+0000 7fea7fc56640 1 --2- 172.21.15.63:0/3970678307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea7806e0a0 0x7fea781559f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.352+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 >> 172.21.15.63:0/3970678307 conn(0x7fea7809d840 msgr2=0x7fea78161c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.352+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 shutdown_connections 2024-09-17T04:23:35.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.352+0000 7fea7fc56640 1 -- 172.21.15.63:0/3970678307 wait complete. 2024-09-17T04:23:35.362 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T04:23:35.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 -- 172.21.15.63:0/2292131111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c160c90 msgr2=0x7f1b5c0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2292131111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c160c90 0x7f1b5c0d0bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b54005fd0 tx=0x7f1b5402aa10 comp rx=0 tx=0).stop 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 -- 172.21.15.63:0/2292131111 shutdown_connections 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2292131111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c160c90 0x7f1b5c0d0bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2292131111 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c0b4530 0x7f1b5c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 -- 172.21.15.63:0/2292131111 >> 172.21.15.63:0/2292131111 conn(0x7f1b5c0cee20 msgr2=0x7f1b5c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 -- 172.21.15.63:0/2292131111 shutdown_connections 2024-09-17T04:23:35.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.480+0000 7f1b63c30640 1 -- 172.21.15.63:0/2292131111 wait complete. 2024-09-17T04:23:35.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.482+0000 7f1b63c30640 1 Processor -- start 2024-09-17T04:23:35.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.482+0000 7f1b63c30640 1 -- start start 2024-09-17T04:23:35.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 0x7f1b5c0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 0x7f1b5c0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0d17d0 con 0x7f1b5c0cff70 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0d1650 con 0x7f1b5c0c7ac0 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b63c30640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c0d1950 con 0x7f1b5c160c90 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36068/0 (socket says 172.21.15.63:36068) 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 -- 172.21.15.63:0/2328648049 learned_addr learned my addr 172.21.15.63:0/2328648049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b621cd640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 0x7f1b5c0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b611cb640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 0x7f1b5c0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 -- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 msgr2=0x7f1b5c0b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 0x7f1b5c0b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 -- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 msgr2=0x7f1b5c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 0x7f1b5c0b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 -- 172.21.15.63:0/2328648049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c0c5f50 con 0x7f1b5c0cff70 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b611cb640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 0x7f1b5c0b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b621cd640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 0x7f1b5c0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.483+0000 7f1b619cc640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c3f0 tx=0x7f1b5800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.484+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58017070 con 0x7f1b5c0cff70 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.484+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b580035f0 con 0x7f1b5c0cff70 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.484+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b58003a40 con 0x7f1b5c0cff70 2024-09-17T04:23:35.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.484+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c0c6230 con 0x7f1b5c0cff70 2024-09-17T04:23:35.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.484+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c0c67f0 con 0x7f1b5c0cff70 2024-09-17T04:23:35.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.485+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c0d1e00 con 0x7f1b5c0cff70 2024-09-17T04:23:35.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.486+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b5801a070 con 0x7f1b5c0cff70 2024-09-17T04:23:35.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.486+0000 7f1b527fc640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 0x7f1b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.486+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b5809a3b0 con 0x7f1b5c0cff70 2024-09-17T04:23:35.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.487+0000 7f1b611cb640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 0x7f1b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.487+0000 7f1b611cb640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 0x7f1b4007b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c157ce0 tx=0x7f1b4c005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.490+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b58021020 con 0x7f1b5c0cff70 2024-09-17T04:23:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.675+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b5c0b7730 con 0x7f1b5c0cff70 2024-09-17T04:23:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.676+0000 7f1b527fc640 1 -- 172.21.15.63:0/2328648049 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f1b580628d0 con 0x7f1b5c0cff70 2024-09-17T04:23:35.676 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:35.677 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 msgr2=0x7f1b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 0x7f1b4007b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c157ce0 tx=0x7f1b4c005ef0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 msgr2=0x7f1b5c0c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c3f0 tx=0x7f1b5800c8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 shutdown_connections 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1b40078b90 0x7f1b4007b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1b5c0c7ac0 0x7f1b5c0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1b5c160c90 0x7f1b5c0b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 --2- 172.21.15.63:0/2328648049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b5c0cff70 0x7f1b5c0c6ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 >> 172.21.15.63:0/2328648049 conn(0x7f1b5c0cee20 msgr2=0x7f1b5c152130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 shutdown_connections 2024-09-17T04:23:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.679+0000 7f1b63c30640 1 -- 172.21.15.63:0/2328648049 wait complete. 2024-09-17T04:23:35.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T04:23:35.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T04:23:35.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T04:23:35.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T04:23:35.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T04:23:35.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T04:23:35.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T04:23:35.693 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T04:23:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.926+0000 7fac9b7fe640 1 -- 172.21.15.63:0/2471070538 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94008b20 con 0x7fac9c0afac0 2024-09-17T04:23:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.926+0000 7fa9108b0640 1 -- 172.21.15.63:0/3205522942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ccec0 msgr2=0x7fa90c0cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.926+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3205522942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ccec0 0x7fa90c0cdb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009900 tx=0x7fa8fc02a580 comp rx=0 tx=0).stop 2024-09-17T04:23:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 -- 172.21.15.63:0/2471070538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0afac0 msgr2=0x7fac9c0afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 --2- 172.21.15.63:0/2471070538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0afac0 0x7fac9c0afed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac9400c1e0 tx=0x7fac9402b9e0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f408cafc640 1 -- 172.21.15.63:0/27547907 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080031b80 con 0x7f40880cd240 2024-09-17T04:23:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 -- 172.21.15.63:0/710912991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15ea80 msgr2=0x7f839c162f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 --2- 172.21.15.63:0/710912991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15ea80 0x7f839c162f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f839c06dca0 tx=0x7f839002a530 comp rx=0 tx=0).stop 2024-09-17T04:23:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 -- 172.21.15.63:0/3205522942 shutdown_connections 2024-09-17T04:23:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 -- 172.21.15.63:0/2471070538 shutdown_connections 2024-09-17T04:23:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 --2- 172.21.15.63:0/2471070538 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0afac0 0x7fac9c0afed0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 --2- 172.21.15.63:0/2471070538 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0cc380 0x7fac9c074c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7faca3101640 1 -- 172.21.15.63:0/2471070538 >> 172.21.15.63:0/2471070538 conn(0x7fac9c0b1e80 msgr2=0x7fac9c0b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3205522942 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ccec0 0x7fa90c0cdb20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3205522942 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0c9950 0x7fa90c144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 -- 172.21.15.63:0/3205522942 >> 172.21.15.63:0/3205522942 conn(0x7fa90c06d4a0 msgr2=0x7fa90c06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 -- 172.21.15.63:0/3205522942 shutdown_connections 2024-09-17T04:23:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7fa9108b0640 1 -- 172.21.15.63:0/3205522942 wait complete. 2024-09-17T04:23:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 -- 172.21.15.63:0/710912991 shutdown_connections 2024-09-17T04:23:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 --2- 172.21.15.63:0/710912991 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15fa60 0x7f839c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 -- 172.21.15.63:0/27547907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cd240 msgr2=0x7f40880b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 --2- 172.21.15.63:0/27547907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cd240 0x7f40880b2fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f40880b58f0 tx=0x7f408002a720 comp rx=0 tx=0).stop 2024-09-17T04:23:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 --2- 172.21.15.63:0/710912991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15ea80 0x7f839c162f20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 -- 172.21.15.63:0/27547907 shutdown_connections 2024-09-17T04:23:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 --2- 172.21.15.63:0/27547907 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cd240 0x7f40880b2fb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 --2- 172.21.15.63:0/27547907 >> v2:172.21.15.63:3300/0 conn(0x7f40880cf660 0x7f40880cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f408fd62640 1 -- 172.21.15.63:0/27547907 >> 172.21.15.63:0/27547907 conn(0x7f40880b1cb0 msgr2=0x7f40880b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f7105035640 1 -- 172.21.15.63:0/2047461716 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f8036400 con 0x7f71000ccba0 2024-09-17T04:23:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.927+0000 7f83a423f640 1 -- 172.21.15.63:0/710912991 >> 172.21.15.63:0/710912991 conn(0x7f839c06d410 msgr2=0x7f839c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f83a423f640 1 -- 172.21.15.63:0/710912991 shutdown_connections 2024-09-17T04:23:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f83a423f640 1 -- 172.21.15.63:0/710912991 wait complete. 2024-09-17T04:23:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7faca3101640 1 -- 172.21.15.63:0/2471070538 shutdown_connections 2024-09-17T04:23:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f710829b640 1 -- 172.21.15.63:0/2047461716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000ccba0 msgr2=0x7f71000cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 -- 172.21.15.63:0/3793290535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35480369a0 msgr2=0x7f354801c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 --2- 172.21.15.63:0/3793290535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35480369a0 0x7f354801c5e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3550051230 tx=0x7f35500a6630 comp rx=0 tx=0).stop 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 -- 172.21.15.63:0/3793290535 shutdown_connections 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 --2- 172.21.15.63:0/3793290535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f35480369a0 0x7f354801c5e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 --2- 172.21.15.63:0/3793290535 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3548005c90 0x7f3548036460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 --2- 172.21.15.63:0/3793290535 >> v2:172.21.15.112:3300/0 conn(0x7f3548009bd0 0x7f35480df1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f3557b62640 1 -- 172.21.15.63:0/3793290535 >> 172.21.15.63:0/3793290535 conn(0x7f3548051450 msgr2=0x7f3548051890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f3557b62640 1 -- 172.21.15.63:0/3793290535 shutdown_connections 2024-09-17T04:23:35.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f3557b62640 1 -- 172.21.15.63:0/3793290535 wait complete. 2024-09-17T04:23:35.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7faca3101640 1 -- 172.21.15.63:0/2471070538 wait complete. 2024-09-17T04:23:35.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.928+0000 7f710829b640 1 --2- 172.21.15.63:0/2047461716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000ccba0 0x7f71000cf160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70f8005fd0 tx=0x7f70f802aaa0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f408fd62640 1 -- 172.21.15.63:0/27547907 shutdown_connections 2024-09-17T04:23:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f710829b640 1 -- 172.21.15.63:0/2047461716 shutdown_connections 2024-09-17T04:23:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f710829b640 1 --2- 172.21.15.63:0/2047461716 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000ccba0 0x7f71000cf160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f710829b640 1 --2- 172.21.15.63:0/2047461716 >> v2:172.21.15.112:3300/0 conn(0x7f71000cfb00 0x7f710015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f710829b640 1 -- 172.21.15.63:0/2047461716 >> 172.21.15.63:0/2047461716 conn(0x7f71000b1cb0 msgr2=0x7f71000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f710829b640 1 -- 172.21.15.63:0/2047461716 shutdown_connections 2024-09-17T04:23:35.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.929+0000 7f408fd62640 1 -- 172.21.15.63:0/27547907 wait complete. 2024-09-17T04:23:35.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.930+0000 7f710829b640 1 -- 172.21.15.63:0/2047461716 wait complete. 2024-09-17T04:23:35.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7fa9108b0640 1 Processor -- start 2024-09-17T04:23:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7faca3101640 1 Processor -- start 2024-09-17T04:23:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7faca3101640 1 -- start start 2024-09-17T04:23:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 -- 172.21.15.63:0/1402735450 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04440cd4f0 msgr2=0x7f04441628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 --2- 172.21.15.63:0/1402735450 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04440cd4f0 0x7f04441628e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f043c009ca0 tx=0x7f043c02aa30 comp rx=0 tx=0).stop 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 -- 172.21.15.63:0/1402735450 shutdown_connections 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 --2- 172.21.15.63:0/1402735450 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f04440cd4f0 0x7f04441628e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 --2- 172.21.15.63:0/1402735450 >> v2:172.21.15.112:3300/0 conn(0x7f044415f9a0 0x7f04440af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 -- 172.21.15.63:0/1402735450 >> 172.21.15.63:0/1402735450 conn(0x7f04440b20a0 msgr2=0x7f04440b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f83a423f640 1 Processor -- start 2024-09-17T04:23:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7fa9108b0640 1 -- start start 2024-09-17T04:23:35.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f83a423f640 1 -- start start 2024-09-17T04:23:35.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 -- 172.21.15.63:0/1402735450 shutdown_connections 2024-09-17T04:23:35.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f3557b62640 1 Processor -- start 2024-09-17T04:23:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7fd79c7f1640 1 -- 172.21.15.63:0/52287576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd780003a50 msgr2=0x7fd780003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7fd79c7f1640 1 --2- 172.21.15.63:0/52287576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd780003a50 0x7fd780003ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd79000c470 tx=0x7fd780005830 comp rx=0 tx=0).stop 2024-09-17T04:23:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7f408fd62640 1 Processor -- start 2024-09-17T04:23:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7f408fd62640 1 -- start start 2024-09-17T04:23:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7f3557b62640 1 -- start start 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7fd79c7f1640 1 -- 172.21.15.63:0/52287576 shutdown_connections 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7fd79c7f1640 1 --2- 172.21.15.63:0/52287576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd780003a50 0x7fd780003ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.932+0000 7fd79c7f1640 1 -- 172.21.15.63:0/52287576 >> 172.21.15.63:0/52287576 conn(0x7fd78c051450 msgr2=0x7fd78c051890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.931+0000 7f0448c84640 1 -- 172.21.15.63:0/1402735450 wait complete. 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.933+0000 7f710829b640 1 Processor -- start 2024-09-17T04:23:35.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.933+0000 7f710829b640 1 -- start start 2024-09-17T04:23:35.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.933+0000 7fd79c7f1640 1 -- 172.21.15.63:0/52287576 shutdown_connections 2024-09-17T04:23:35.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac9c0afac0 0x7fac9c15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0b5520 0x7fac9c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fa9108b0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 0x7fa90c1f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0cc380 0x7fac9c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f83a423f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 0x7f839c14f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.933+0000 7fd79c7f1640 1 -- 172.21.15.63:0/52287576 wait complete. 2024-09-17T04:23:35.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca0e9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac9c0afac0 0x7fac9c15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c075160 con 0x7fac9c0afac0 2024-09-17T04:23:35.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0ccae0 con 0x7fac9c0cc380 2024-09-17T04:23:35.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca3101640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c0752e0 con 0x7fac9c0b5520 2024-09-17T04:23:35.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f83a423f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f650 0x7f839c161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 0x7fa90c1f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f3557b62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3548005c90 0x7f35480e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 0x7fa90c1f9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36116/0 (socket says 172.21.15.63:36116) 2024-09-17T04:23:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fa90b7fe640 1 -- 172.21.15.63:0/3750351163 learned_addr learned my addr 172.21.15.63:0/3750351163 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f83a1fdb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 0x7f839c14f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f83a1fdb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 0x7f839c14f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37558/0 (socket says 172.21.15.63:37558) 2024-09-17T04:23:35.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0ccec0 0x7fa90c15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca0e9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac9c0afac0 0x7fac9c15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36100/0 (socket says 172.21.15.63:36100) 2024-09-17T04:23:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f83a1fdb640 1 -- 172.21.15.63:0/2278773358 learned_addr learned my addr 172.21.15.63:0/2278773358 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7f3557b62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 0x7f35480eab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f0448c84640 1 Processor -- start 2024-09-17T04:23:35.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca0e9d640 1 -- 172.21.15.63:0/3646565252 learned_addr learned my addr 172.21.15.63:0/3646565252 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7fac9bfff640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0b5520 0x7fac9c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.934+0000 7faca169e640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0cc380 0x7fac9c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a17da640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f650 0x7f839c161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35558fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3548005c90 0x7f35480e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35558fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3548005c90 0x7f35480e8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:46298/0 (socket says 172.21.15.63:46298) 2024-09-17T04:23:35.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a423f640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15fa60 0x7f839c161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35550fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 0x7f35480eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35550fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 0x7f35480eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36122/0 (socket says 172.21.15.63:36122) 2024-09-17T04:23:35.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35558fe640 1 -- 172.21.15.63:0/2935254357 learned_addr learned my addr 172.21.15.63:0/2935254357 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ce060 0x7fa90c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa90affd640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0ccec0 0x7fa90c15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f3557b62640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35480369a0 0x7f354801ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f0448c84640 1 -- start start 2024-09-17T04:23:35.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b44e0 con 0x7f839c15fa60 2024-09-17T04:23:35.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b4360 con 0x7f839c15f650 2024-09-17T04:23:35.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0d0390 con 0x7fa90c0c9950 2024-09-17T04:23:35.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0cfaf0 con 0x7f839c15ea80 2024-09-17T04:23:35.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f354800bde0 con 0x7f3548009bd0 2024-09-17T04:23:35.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0d0510 con 0x7fa90c0ce060 2024-09-17T04:23:35.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f354800bc60 con 0x7f3548005c90 2024-09-17T04:23:35.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f83a27dc640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15fa60 0x7f839c161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c0d0690 con 0x7fa90c0ccec0 2024-09-17T04:23:35.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f35560ff640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35480369a0 0x7f354801ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fa90bfff640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ce060 0x7fa90c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f354801cb20 con 0x7f35480369a0 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f710829b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71000ccba0 0x7f71001563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fac9bfff640 1 -- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0cc380 msgr2=0x7fac9c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fac9bfff640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac9c0cc380 0x7fac9c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fac9bfff640 1 -- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac9c0afac0 msgr2=0x7fac9c15a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fac9bfff640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac9c0afac0 0x7fac9c15a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7fac9bfff640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c1f62f0 con 0x7fac9c0b5520 2024-09-17T04:23:35.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.935+0000 7f710829b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71000ccfb0 0x7f71000b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90bfff640 1 -- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0ccec0 msgr2=0x7fa90c15e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fac9bfff640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0b5520 0x7fac9c15a620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac94032000 tx=0x7fac94008e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f710829b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000cfb00 0x7f710015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 -- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f650 msgr2=0x7f839c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f839c15f650 0x7f839c161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 -- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15fa60 msgr2=0x7f839c161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f839c15fa60 0x7f839c161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0cc710 con 0x7f839c15ea80 2024-09-17T04:23:35.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f710829b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71000cb230 con 0x7f71000ccfb0 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40880cf660 0x7f408816c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f7105836640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71000ccfb0 0x7f71000b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f7105836640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71000ccfb0 0x7f71000b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36136/0 (socket says 172.21.15.63:36136) 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f7105836640 1 -- 172.21.15.63:0/1164360664 learned_addr learned my addr 172.21.15.63:0/1164360664 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f71000cb0b0 con 0x7f71000ccba0 2024-09-17T04:23:35.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f710006ee90 con 0x7f71000cfb00 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cfb90 0x7f40880adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40880ae1a0 0x7f40880ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40880710a0 con 0x7f40880cf660 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4088070f20 con 0x7f40880cfb90 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408fd62640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f40880b34f0 con 0x7f40880ae1a0 2024-09-17T04:23:35.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f7106037640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71000ccba0 0x7f71001563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f7106838640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000cfb00 0x7f710015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fd79c7f1640 1 Processor -- start 2024-09-17T04:23:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90bfff640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0ccec0 0x7fa90c15e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90bfff640 1 -- 172.21.15.63:0/3750351163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 msgr2=0x7fa90c1f9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fd79c7f1640 1 -- start start 2024-09-17T04:23:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408dafe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40880cf660 0x7f408816c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408dafe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40880cf660 0x7f408816c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36142/0 (socket says 172.21.15.63:36142) 2024-09-17T04:23:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408dafe640 1 -- 172.21.15.63:0/1360051154 learned_addr learned my addr 172.21.15.63:0/1360051154 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408d2fd640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cfb90 0x7f40880adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f408e2ff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40880ae1a0 0x7f40880ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90bfff640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 0x7fa90c1f9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f83a1fdb640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 0x7f839c14f8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8390034040 tx=0x7f8390003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90bfff640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c15ed10 con 0x7fa90c0ce060 2024-09-17T04:23:35.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90affd640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa90c0ccec0 0x7fa90c15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f35550fd640 1 -- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35480369a0 msgr2=0x7f354801ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f35550fd640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f35480369a0 0x7f354801ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f35550fd640 1 -- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3548005c90 msgr2=0x7f35480e8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7fa90b7fe640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa90c0c9950 0x7fa90c1f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:35.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f35550fd640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3548005c90 0x7f35480e8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.936+0000 7f35550fd640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354801e570 con 0x7f3548009bd0 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 -- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000cfb00 msgr2=0x7f710015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f71000cfb00 0x7f710015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 -- 172.21.15.63:0/1164360664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71000ccfb0 msgr2=0x7f71000b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71000ccfb0 0x7f71000b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71000c9620 con 0x7f71000ccba0 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fa90bfff640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ce060 0x7fa90c0b1e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ca00 tx=0x7fa90400cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94034040 con 0x7fac9c0b5520 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac94042070 con 0x7fac9c0b5520 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f408e2ff640 1 -- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cfb90 msgr2=0x7f40880adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f408e2ff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40880cfb90 0x7f40880adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f408e2ff640 1 -- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40880cf660 msgr2=0x7f408816c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f408e2ff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40880cf660 0x7f408816c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94004040 con 0x7fac9c0b5520 2024-09-17T04:23:35.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f408e2ff640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088205430 con 0x7f40880ae1a0 2024-09-17T04:23:35.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c1f65d0 con 0x7fac9c0b5520 2024-09-17T04:23:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839003e070 con 0x7f839c15ea80 2024-09-17T04:23:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400a640 con 0x7fa90c0ce060 2024-09-17T04:23:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c1f8430 con 0x7fac9c0b5520 2024-09-17T04:23:35.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8390004ab0 con 0x7f839c15ea80 2024-09-17T04:23:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f7106037640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71000ccba0 0x7f71001563f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c8f0 tx=0x7f70f000cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa904017070 con 0x7fa90c0ce060 2024-09-17T04:23:35.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f0448c84640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f044415f9a0 0x7f04441597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f0448c84640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 0x7f04440c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0448c84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f044415e760 0x7f0444073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f044259c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f044415f9a0 0x7f04441597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0441d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 0x7f04440c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0441d9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 0x7f04440c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:46310/0 (socket says 172.21.15.63:46310) 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0441d9b640 1 -- 172.21.15.63:0/301580320 learned_addr learned my addr 172.21.15.63:0/301580320 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0442d9d640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f044415e760 0x7f0444073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f044415c120 con 0x7f044415e760 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f044415bfa0 con 0x7f04441624d0 2024-09-17T04:23:35.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f044415c2a0 con 0x7f044415f9a0 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f35550fd640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 0x7f35480eab20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e680 tx=0x7f354c00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c00cab0 con 0x7f3548009bd0 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c1f9ab0 con 0x7fa90c0ce060 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0007bb0 con 0x7f71000ccba0 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70f000ae40 con 0x7f71000ccba0 2024-09-17T04:23:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.937+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0005280 con 0x7f71000ccba0 2024-09-17T04:23:35.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd780003a50 0x7fd78c0dd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd78c02b8f0 0x7fd78c02bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390035040 con 0x7f839c15ea80 2024-09-17T04:23:35.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c034cc0 0x7fd78c0350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c0caae0 con 0x7f839c15ea80 2024-09-17T04:23:35.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c0df1b0 con 0x7fd78c02b8f0 2024-09-17T04:23:35.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c00be70 con 0x7fd780003a50 2024-09-17T04:23:35.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400abb0 con 0x7fa90c0ce060 2024-09-17T04:23:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1f5f00 con 0x7f839c15ea80 2024-09-17T04:23:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7fd79c7f1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd78c0df330 con 0x7fd78c034cc0 2024-09-17T04:23:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71000c9900 con 0x7f71000ccba0 2024-09-17T04:23:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac9c0b5bd0 con 0x7fac9c0b5520 2024-09-17T04:23:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71000b05b0 con 0x7f71000ccba0 2024-09-17T04:23:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd79a58d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd780003a50 0x7fd78c0dd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd79a58d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd780003a50 0x7fd78c0dd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:46324/0 (socket says 172.21.15.63:46324) 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f408e2ff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40880ae1a0 0x7f40880ccb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4088070d60 tx=0x7f4080032e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd79a58d640 1 -- 172.21.15.63:0/427492372 learned_addr learned my addr 172.21.15.63:0/427492372 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f0441d9b640 1 -- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f044415f9a0 msgr2=0x7f04441597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f0441d9b640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f044415f9a0 0x7f04441597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f0441d9b640 1 -- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f044415e760 msgr2=0x7f0444073e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f0441d9b640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f044415e760 0x7f0444073e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f0441d9b640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044415d6c0 con 0x7f04441624d0 2024-09-17T04:23:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd78c02b8f0 0x7fd78c02bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd79ad8e640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c034cc0 0x7fd78c0350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 -- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c034cc0 msgr2=0x7fd78c0350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd78c034cc0 0x7fd78c0350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.938+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354801ff90 con 0x7f3548009bd0 2024-09-17T04:23:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f354c00cd40 con 0x7f3548009bd0 2024-09-17T04:23:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 -- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd780003a50 msgr2=0x7fd78c0dd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:35.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd780003a50 0x7fd78c0dd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c035610 con 0x7fd78c02b8f0 2024-09-17T04:23:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fd799d8c640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd78c02b8f0 0x7fd78c02bd00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd79406ad50 tx=0x7fd79406a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.939+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c1607f0 con 0x7fa90c0ce060 2024-09-17T04:23:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f839c075310 con 0x7f839c15ea80 2024-09-17T04:23:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080041020 con 0x7f40880ae1a0 2024-09-17T04:23:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71000cbfa0 con 0x7f71000ccba0 2024-09-17T04:23:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4080003ff0 con 0x7f40880ae1a0 2024-09-17T04:23:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa904007050 con 0x7fa90c0ce060 2024-09-17T04:23:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f408fd62640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4088205710 con 0x7f40880ae1a0 2024-09-17T04:23:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f408fd62640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4088205cd0 con 0x7f40880ae1a0 2024-09-17T04:23:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8390041070 con 0x7f839c15ea80 2024-09-17T04:23:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.941+0000 7fa8f3fff640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa8f8078bc0 0x7fa8f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.941+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa90409a770 con 0x7fa90c0ce060 2024-09-17T04:23:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa90c15eee0 0x7fa90c13ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa90c144b50 con 0x7fa90c15eee0 2024-09-17T04:23:35.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.941+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70f0005420 con 0x7f71000ccba0 2024-09-17T04:23:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f838e7fc640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8380078c60 0x7f838007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7f70f6ffd640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f70e4078bc0 0x7f70e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac94037020 con 0x7fac9c0b5520 2024-09-17T04:23:35.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f83900bbfb0 con 0x7f839c15ea80 2024-09-17T04:23:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7940745e0 con 0x7fd78c02b8f0 2024-09-17T04:23:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd794074780 con 0x7fd78c02b8f0 2024-09-17T04:23:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794074b30 con 0x7fd78c02b8f0 2024-09-17T04:23:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f70f009b4a0 con 0x7f71000ccba0 2024-09-17T04:23:35.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f838e7fc640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f8380080f30 0x7f8380083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8390005310 con 0x7f8380080f30 2024-09-17T04:23:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080036040 con 0x7f40880ae1a0 2024-09-17T04:23:35.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f83900bc3a0 con 0x7f839c15ea80 2024-09-17T04:23:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f70f6ffd640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7f70e4080e30 0x7f70e4083280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70f003be50 con 0x7f70e4080e30 2024-09-17T04:23:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f70f009b890 con 0x7f71000ccba0 2024-09-17T04:23:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fd79c7f1640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c02c620 con 0x7fd78c02b8f0 2024-09-17T04:23:35.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f7105836640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f70e4078bc0 0x7f70e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fd79c7f1640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c020bd0 con 0x7fd78c02b8f0 2024-09-17T04:23:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4068001030 con 0x7f40880ae1a0 2024-09-17T04:23:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7f7106838640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7f70e4080e30 0x7f70e4083280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f83a27dc640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f8380080f30 0x7f8380083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7fa90b7fe640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa8f8078bc0 0x7fa8f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7fa90affd640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa90c15eee0 0x7fa90c13ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4080044020 con 0x7f40880ae1a0 2024-09-17T04:23:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fa90b7fe640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa8f8078bc0 0x7fa8f807b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9000058c0 tx=0x7fa900005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.943+0000 7fa90affd640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa90c15eee0 0x7fa90c13ed40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.941+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354801e810 con 0x7f3548009bd0 2024-09-17T04:23:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3548039280 con 0x7f3548009bd0 2024-09-17T04:23:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c010690 con 0x7f3548009bd0 2024-09-17T04:23:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f354c0108b0 con 0x7f3548009bd0 2024-09-17T04:23:35.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f0441d9b640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 0x7f04440c8950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f043800c3c0 tx=0x7f043800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438017070 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044415d9a0 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044415df60 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.940+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04380053e0 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.941+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438003870 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.942+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0428001030 con 0x7f04441624d0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f7106838640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7f70e4080e30 0x7f70e4083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7fac997fa640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fac80078be0 0x7fac8007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7fd79c7f1640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd78c036540 con 0x7fd78c02b8f0 2024-09-17T04:23:35.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f7105836640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f70e4078bc0 0x7f70e407b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71000cf650 tx=0x7f70f8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== osd.7 v2:172.21.15.112:6818/843462089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa90c144b50 con 0x7fa90c15eee0 2024-09-17T04:23:35.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f35467fc640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3534078c10 0x7f353407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac940bbc00 con 0x7fac9c0b5520 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7fac997fa640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7fac80080e50 0x7fac800832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac94047e50 con 0x7fac80080e50 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fac940bc0e0 con 0x7fac9c0b5520 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f043801a070 con 0x7f04441624d0 2024-09-17T04:23:35.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7faca169e640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7fac80080e50 0x7fac800832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7faca0e9d640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fac80078be0 0x7fac8007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.944+0000 7f83a27dc640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f8380080f30 0x7f8380083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f83a17da640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8380078c60 0x7f838007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== osd.2 v2:172.21.15.63:6824/59655443 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8390005310 con 0x7f8380080f30 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f407e7fc640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f406c078c60 0x7f406c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f40800bbb80 con 0x7f40880ae1a0 2024-09-17T04:23:35.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f407e7fc640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7f406c080eb0 0x7f406c083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f408dafe640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f406c078c60 0x7f406c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f408002eec0 con 0x7f406c080eb0 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40800c2050 con 0x7f40880ae1a0 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f35558fe640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3534078c10 0x7f353407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f354c0a0060 con 0x7f3548009bd0 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f35467fc640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f3534080e00 0x7f3534083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f354c004470 con 0x7f3534080e00 2024-09-17T04:23:35.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.945+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== osd.6 v2:172.21.15.112:6810/3726125666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70f003be50 con 0x7f70e4080e30 2024-09-17T04:23:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f408d2fd640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7f406c080eb0 0x7f406c083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f35560ff640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f3534080e00 0x7f3534083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7f0432ffd640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f04240814a0 0x7f04240839b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f044259c640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f04240814a0 0x7f04240839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7faca169e640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7fac80080e50 0x7fac800832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f354c05fa40 con 0x7f3548009bd0 2024-09-17T04:23:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.946+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd794074cd0 con 0x7fd78c02b8f0 2024-09-17T04:23:35.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f83a17da640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8380078c60 0x7f838007b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f839c14d6e0 tx=0x7f8398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f408dafe640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f406c078c60 0x7f406c07b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4084009bc0 tx=0x7f4084009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f043809a2d0 con 0x7f04441624d0 2024-09-17T04:23:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f0432ffd640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7f0424089710 0x7f042408bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:35.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7faca0e9d640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fac80078be0 0x7fac8007b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac90005860 tx=0x7fac9000b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f408d2fd640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7f406c080eb0 0x7f406c083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0438016ec0 con 0x7f0424089710 2024-09-17T04:23:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== mon.1 v2:172.21.15.112:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f043809a6c0 con 0x7f04441624d0 2024-09-17T04:23:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f0442d9d640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7f0424089710 0x7f042408bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:35.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f044259c640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f04240814a0 0x7f04240839b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043400bb50 tx=0x7f043400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f35558fe640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3534078c10 0x7f353407b120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3540009b70 tx=0x7f3540005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.947+0000 7f35560ff640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f3534080e00 0x7f3534083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== osd.1 v2:172.21.15.63:6800/3223774587 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac94047e50 con 0x7fac80080e50 2024-09-17T04:23:35.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7f0442d9d640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7f0424089710 0x7f042408bb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== osd.4 v2:172.21.15.112:6826/4200339545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f354c004470 con 0x7f3534080e00 2024-09-17T04:23:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.949+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== osd.3 v2:172.21.15.63:6808/126176733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f408002eec0 con 0x7f406c080eb0 2024-09-17T04:23:35.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.949+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== osd.0 v2:172.21.15.63:6816/3094040148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0438016ec0 con 0x7f0424089710 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd78affd640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd778078be0 0x7fd77807b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7941178b0 con 0x7fd78c02b8f0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd78affd640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7fd778080e50 0x7fd7780832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd778083970 con 0x7fd778080e50 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd794117d90 con 0x7fd78c02b8f0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.948+0000 7fd79a58d640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd778078be0 0x7fd77807b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.949+0000 7fd79ad8e640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7fd778080e50 0x7fd7780832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.949+0000 7fd79a58d640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd778078be0 0x7fd77807b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd790001000 tx=0x7fd790001ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.949+0000 7fd79ad8e640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7fd778080e50 0x7fd7780832a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.950+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== osd.5 v2:172.21.15.112:6802/3916391572 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd778083970 con 0x7fd778080e50 2024-09-17T04:23:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.976+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 --> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa90c145960 con 0x7fa90c15eee0 2024-09-17T04:23:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.977+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 --> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71000cf160 con 0x7f70e4080e30 2024-09-17T04:23:36.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.977+0000 7fa8f3fff640 1 -- 172.21.15.63:0/3750351163 <== osd.7 v2:172.21.15.112:6818/843462089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa90c145960 con 0x7fa90c15eee0 2024-09-17T04:23:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.977+0000 7f70f6ffd640 1 -- 172.21.15.63:0/1164360664 <== osd.6 v2:172.21.15.112:6810/3726125666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f71000cf160 con 0x7f70e4080e30 2024-09-17T04:23:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa90c15eee0 msgr2=0x7fa90c13ed40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa90c15eee0 0x7fa90c13ed40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa8f8078bc0 msgr2=0x7fa8f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa8f8078bc0 0x7fa8f807b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9000058c0 tx=0x7fa900005f10 comp rx=0 tx=0).stop 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ce060 msgr2=0x7fa90c0b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7fa9108b0640 1 --2- 172.21.15.63:0/3750351163 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa90c0ce060 0x7fa90c0b1e80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa90400ca00 tx=0x7fa90400cec0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7f70e4080e30 msgr2=0x7f70e4083280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7f710829b640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7f70e4080e30 0x7f70e4083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 --> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f839c150040 con 0x7f8380080f30 2024-09-17T04:23:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f70e4078bc0 msgr2=0x7f70e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.978+0000 7f710829b640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f70e4078bc0 0x7f70e407b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71000cf650 tx=0x7f70f8038040 comp rx=0 tx=0).stop 2024-09-17T04:23:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71000ccba0 msgr2=0x7f71001563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f710829b640 1 --2- 172.21.15.63:0/1164360664 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f71000ccba0 0x7f71001563f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70f000c8f0 tx=0x7f70f000cdb0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f7106838640 1 -- 172.21.15.63:0/1164360664 reap_dead start 2024-09-17T04:23:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 shutdown_connections 2024-09-17T04:23:36.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 >> 172.21.15.63:0/1164360664 conn(0x7f71000b1cb0 msgr2=0x7f71000d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f838e7fc640 1 -- 172.21.15.63:0/2278773358 <== osd.2 v2:172.21.15.63:6824/59655443 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f839c150040 con 0x7f8380080f30 2024-09-17T04:23:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f8380080f30 msgr2=0x7f8380083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f8380080f30 0x7f8380083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8380078c60 msgr2=0x7f838007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8380078c60 0x7f838007b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f839c14d6e0 tx=0x7f8398008040 comp rx=0 tx=0).stop 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 msgr2=0x7f839c14f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 --2- 172.21.15.63:0/2278773358 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f839c15ea80 0x7f839c14f8a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8390034040 tx=0x7f8390003b20 comp rx=0 tx=0).stop 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a27dc640 1 -- 172.21.15.63:0/2278773358 reap_dead start 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 shutdown_connections 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7fa90bfff640 1 -- 172.21.15.63:0/3750351163 reap_dead start 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 shutdown_connections 2024-09-17T04:23:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 >> 172.21.15.63:0/3750351163 conn(0x7fa90c06d4a0 msgr2=0x7fa90c0cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.979+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 shutdown_connections 2024-09-17T04:23:36.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7f710829b640 1 -- 172.21.15.63:0/1164360664 wait complete. 2024-09-17T04:23:36.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 >> 172.21.15.63:0/2278773358 conn(0x7f839c06d410 msgr2=0x7f839c160200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 --> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac9c1f6080 con 0x7fac80080e50 2024-09-17T04:23:36.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 shutdown_connections 2024-09-17T04:23:36.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 shutdown_connections 2024-09-17T04:23:36.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7f83a423f640 1 -- 172.21.15.63:0/2278773358 wait complete. 2024-09-17T04:23:36.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7fa9108b0640 1 -- 172.21.15.63:0/3750351163 wait complete. 2024-09-17T04:23:36.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 --> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f354801fd00 con 0x7f3534080e00 2024-09-17T04:23:36.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.980+0000 7fac997fa640 1 -- 172.21.15.63:0/3646565252 <== osd.1 v2:172.21.15.63:6800/3223774587 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac9c1f6080 con 0x7fac80080e50 2024-09-17T04:23:36.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 --> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0428002dd0 con 0x7f0424089710 2024-09-17T04:23:36.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 --> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4068002dd0 con 0x7f406c080eb0 2024-09-17T04:23:36.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7f35467fc640 1 -- 172.21.15.63:0/2935254357 <== osd.4 v2:172.21.15.112:6826/4200339545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f354801fd00 con 0x7f3534080e00 2024-09-17T04:23:36.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7fd79c7f1640 1 -- 172.21.15.63:0/427492372 --> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd78c02c3d0 con 0x7fd778080e50 2024-09-17T04:23:36.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7f0432ffd640 1 -- 172.21.15.63:0/301580320 <== osd.0 v2:172.21.15.63:6816/3094040148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0428002dd0 con 0x7f0424089710 2024-09-17T04:23:36.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7fac80080e50 msgr2=0x7fac800832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7faca3101640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7fac80080e50 0x7fac800832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7f407e7fc640 1 -- 172.21.15.63:0/1360051154 <== osd.3 v2:172.21.15.63:6808/126176733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4068002dd0 con 0x7f406c080eb0 2024-09-17T04:23:36.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fac80078be0 msgr2=0x7fac8007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.981+0000 7fd78affd640 1 -- 172.21.15.63:0/427492372 <== osd.5 v2:172.21.15.112:6802/3916391572 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd78c02c3d0 con 0x7fd778080e50 2024-09-17T04:23:36.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca3101640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fac80078be0 0x7fac8007b0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac90005860 tx=0x7fac9000b390 comp rx=0 tx=0).stop 2024-09-17T04:23:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0b5520 msgr2=0x7fac9c15a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca3101640 1 --2- 172.21.15.63:0/3646565252 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac9c0b5520 0x7fac9c15a620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac94032000 tx=0x7fac94008e20 comp rx=0 tx=0).stop 2024-09-17T04:23:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7f0424089710 msgr2=0x7f042408bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7f0424089710 0x7f042408bb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca169e640 1 -- 172.21.15.63:0/3646565252 reap_dead start 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f04240814a0 msgr2=0x7f04240839b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f04240814a0 0x7f04240839b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f043400bb50 tx=0x7f043400b2e0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 msgr2=0x7f04440c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 --2- 172.21.15.63:0/301580320 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f04441624d0 0x7f04440c8950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f043800c3c0 tx=0x7f043800c880 comp rx=0 tx=0).stop 2024-09-17T04:23:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0442d9d640 1 -- 172.21.15.63:0/301580320 reap_dead start 2024-09-17T04:23:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 shutdown_connections 2024-09-17T04:23:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 >> 172.21.15.63:0/3646565252 conn(0x7fac9c0b1e80 msgr2=0x7fac9c0b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7fd778080e50 msgr2=0x7fd7780832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7fd788ff9640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7fd778080e50 0x7fd7780832a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f3534080e00 msgr2=0x7f3534083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7f406c080eb0 msgr2=0x7f406c083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f4073fff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7f406c080eb0 0x7f406c083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f3557b62640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f3534080e00 0x7f3534083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 shutdown_connections 2024-09-17T04:23:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 >> 172.21.15.63:0/301580320 conn(0x7f04440b20a0 msgr2=0x7f0444160010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3534078c10 msgr2=0x7f353407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f3557b62640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3534078c10 0x7f353407b120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3540009b70 tx=0x7f3540005f30 comp rx=0 tx=0).stop 2024-09-17T04:23:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.982+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f406c078c60 msgr2=0x7f406c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 shutdown_connections 2024-09-17T04:23:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f406c078c60 0x7f406c07b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4084009bc0 tx=0x7f4084009260 comp rx=0 tx=0).stop 2024-09-17T04:23:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 msgr2=0x7f35480eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f3557b62640 1 --2- 172.21.15.63:0/2935254357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3548009bd0 0x7f35480eab20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f354c00e680 tx=0x7f354c00eb40 comp rx=0 tx=0).stop 2024-09-17T04:23:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f0448c84640 1 -- 172.21.15.63:0/301580320 wait complete. 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f35560ff640 1 -- 172.21.15.63:0/2935254357 reap_dead start 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40880ae1a0 msgr2=0x7f40880ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 --2- 172.21.15.63:0/1360051154 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40880ae1a0 0x7f40880ccb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4088070d60 tx=0x7f4080032e90 comp rx=0 tx=0).stop 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f408e2ff640 1 -- 172.21.15.63:0/1360051154 reap_dead start 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd778078be0 msgr2=0x7fd77807b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd778078be0 0x7fd77807b0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd790001000 tx=0x7fd790001ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 shutdown_connections 2024-09-17T04:23:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 >> 172.21.15.63:0/1360051154 conn(0x7f40880b1cb0 msgr2=0x7f40880b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 shutdown_connections 2024-09-17T04:23:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 >> 172.21.15.63:0/2935254357 conn(0x7f3548051450 msgr2=0x7f35480eb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd78c02b8f0 msgr2=0x7fd78c02bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 --2- 172.21.15.63:0/427492372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd78c02b8f0 0x7fd78c02bd00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd79406ad50 tx=0x7fd79406a000 comp rx=0 tx=0).stop 2024-09-17T04:23:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd79ad8e640 1 -- 172.21.15.63:0/427492372 reap_dead start 2024-09-17T04:23:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 shutdown_connections 2024-09-17T04:23:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 shutdown_connections 2024-09-17T04:23:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f4073fff640 1 -- 172.21.15.63:0/1360051154 wait complete. 2024-09-17T04:23:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 >> 172.21.15.63:0/427492372 conn(0x7fd78c051450 msgr2=0x7fd78c0de370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 shutdown_connections 2024-09-17T04:23:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7faca3101640 1 -- 172.21.15.63:0/3646565252 wait complete. 2024-09-17T04:23:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.983+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 shutdown_connections 2024-09-17T04:23:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.984+0000 7f3557b62640 1 -- 172.21.15.63:0/2935254357 wait complete. 2024-09-17T04:23:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.984+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 shutdown_connections 2024-09-17T04:23:36.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:35.984+0000 7fd788ff9640 1 -- 172.21.15.63:0/427492372 wait complete. 2024-09-17T04:23:36.027 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-17T04:23:36.028 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-17T04:23:36.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T04:23:36.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T04:23:36.031 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T04:23:36.032 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T04:23:36.033 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T04:23:36.034 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.034 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T04:23:36.035 INFO:teuthology.orchestra.run.smithi063.stdout:55834574855 2024-09-17T04:23:36.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T04:23:36.036 INFO:teuthology.orchestra.run.smithi063.stdout:55834574855 2024-09-17T04:23:36.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T04:23:36.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.294+0000 7f8d55225640 1 -- 172.21.15.63:0/1199769396 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48030c80 con 0x7f8d500cd240 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 -- 172.21.15.63:0/4270442702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c0c4270 msgr2=0x7f6e3c0c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/4270442702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c0c4270 0x7f6e3c0c4680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c06de50 tx=0x7f6e3002a580 comp rx=0 tx=0).stop 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 -- 172.21.15.63:0/4270442702 shutdown_connections 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/4270442702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c0c4270 0x7f6e3c0c4680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/4270442702 >> v2:172.21.15.112:3300/0 conn(0x7f6e3c0d1e30 0x7f6e3c0b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 -- 172.21.15.63:0/4270442702 >> 172.21.15.63:0/4270442702 conn(0x7f6e3c0d12a0 msgr2=0x7f6e3c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 -- 172.21.15.63:0/4270442702 shutdown_connections 2024-09-17T04:23:36.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 -- 172.21.15.63:0/1199769396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cd240 msgr2=0x7f8d500b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 --2- 172.21.15.63:0/1199769396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cd240 0x7f8d500b2fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005fd0 tx=0x7f8d4802a930 comp rx=0 tx=0).stop 2024-09-17T04:23:36.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f6e42ed5640 1 -- 172.21.15.63:0/4270442702 wait complete. 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 -- 172.21.15.63:0/2817137778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1164073e70 msgr2=0x7f1164074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 --2- 172.21.15.63:0/2817137778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1164073e70 0x7f1164074280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1158009830 tx=0x7f115802a510 comp rx=0 tx=0).stop 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 -- 172.21.15.63:0/2817137778 shutdown_connections 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 --2- 172.21.15.63:0/2817137778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1164073e70 0x7f1164074280 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 --2- 172.21.15.63:0/2817137778 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f116415c9b0 0x7f11640ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 -- 172.21.15.63:0/2817137778 >> 172.21.15.63:0/2817137778 conn(0x7f11640cdc60 msgr2=0x7f11640ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f6e42ed5640 1 Processor -- start 2024-09-17T04:23:36.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 -- 172.21.15.63:0/2817137778 shutdown_connections 2024-09-17T04:23:36.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f116a9c3640 1 -- 172.21.15.63:0/2817137778 wait complete. 2024-09-17T04:23:36.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f6e42ed5640 1 -- start start 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 -- 172.21.15.63:0/1199769396 shutdown_connections 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 --2- 172.21.15.63:0/1199769396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cd240 0x7f8d500b2fb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 --2- 172.21.15.63:0/1199769396 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d500cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 -- 172.21.15.63:0/1199769396 >> 172.21.15.63:0/1199769396 conn(0x7f8d500b1cb0 msgr2=0x7f8d500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 -- 172.21.15.63:0/1199769396 shutdown_connections 2024-09-17T04:23:36.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.295+0000 7f8d5848b640 1 -- 172.21.15.63:0/1199769396 wait complete. 2024-09-17T04:23:36.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.298+0000 7f8d5848b640 1 Processor -- start 2024-09-17T04:23:36.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.299+0000 7f8d5848b640 1 -- start start 2024-09-17T04:23:36.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.300+0000 7f382b59e640 1 -- 172.21.15.63:0/120710364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c0cb5c0 msgr2=0x7f382c165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.300+0000 7f382b59e640 1 --2- 172.21.15.63:0/120710364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c0cb5c0 0x7f382c165430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3824005fd0 tx=0x7f382402a940 comp rx=0 tx=0).stop 2024-09-17T04:23:36.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f382b59e640 1 -- 172.21.15.63:0/120710364 shutdown_connections 2024-09-17T04:23:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f382b59e640 1 --2- 172.21.15.63:0/120710364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c0cb5c0 0x7f382c165430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f382b59e640 1 -- 172.21.15.63:0/120710364 >> 172.21.15.63:0/120710364 conn(0x7f382c06d4a0 msgr2=0x7f382c06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 -- 172.21.15.63:0/126455224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff668070d90 msgr2=0x7ff668073160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 --2- 172.21.15.63:0/126455224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff668070d90 0x7ff668073160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff660009830 tx=0x7ff66002a480 comp rx=0 tx=0).stop 2024-09-17T04:23:36.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f382b59e640 1 -- 172.21.15.63:0/120710364 shutdown_connections 2024-09-17T04:23:36.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f382b59e640 1 -- 172.21.15.63:0/120710364 wait complete. 2024-09-17T04:23:36.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 -- 172.21.15.63:0/126455224 shutdown_connections 2024-09-17T04:23:36.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 --2- 172.21.15.63:0/126455224 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff668070d90 0x7ff668073160 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff660009830 tx=0x7ff66002a480 comp rx=0 tx=0).stop 2024-09-17T04:23:36.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 -- 172.21.15.63:0/126455224 >> 172.21.15.63:0/126455224 conn(0x7ff66806d870 msgr2=0x7ff66806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f6e42ed5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 0x7f6e3c0b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f6e42ed5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e40c71640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 0x7f6e3c0b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e40c71640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 0x7f6e3c0b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37680/0 (socket says 172.21.15.63:37680) 2024-09-17T04:23:36.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 -- 172.21.15.63:0/126455224 shutdown_connections 2024-09-17T04:23:36.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7ff66d920640 1 -- 172.21.15.63:0/126455224 wait complete. 2024-09-17T04:23:36.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 -- 172.21.15.63:0/2990231853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec071330 msgr2=0x7f84ec15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 --2- 172.21.15.63:0/2990231853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec071330 0x7f84ec15c7b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f84e4005fd0 tx=0x7f84e402aa10 comp rx=0 tx=0).stop 2024-09-17T04:23:36.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 -- 172.21.15.63:0/2990231853 shutdown_connections 2024-09-17T04:23:36.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36254/0 (socket says 172.21.15.63:36254) 2024-09-17T04:23:36.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e40c71640 1 -- 172.21.15.63:0/3731718798 learned_addr learned my addr 172.21.15.63:0/3731718798 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c1fd1e0 0x7f6e3c1fd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 --2- 172.21.15.63:0/2990231853 >> v2:172.21.15.63:3300/0 conn(0x7f84ec074560 0x7f84ec0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 --2- 172.21.15.63:0/2990231853 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec071330 0x7f84ec15c7b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f84f168b640 1 -- 172.21.15.63:0/2990231853 >> 172.21.15.63:0/2990231853 conn(0x7f84ec0b2e10 msgr2=0x7f84ec0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f116a9c3640 1 Processor -- start 2024-09-17T04:23:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f116a9c3640 1 -- start start 2024-09-17T04:23:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f33cf59e640 1 -- 172.21.15.63:0/2507505407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b14d0 msgr2=0x7f33d009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f33cf59e640 1 --2- 172.21.15.63:0/2507505407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b14d0 0x7f33d009aa30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f33c0005fd0 tx=0x7f33c002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1673c0 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 -- 172.21.15.63:0/2507505407 shutdown_connections 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 --2- 172.21.15.63:0/2507505407 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b1f90 0x7f33d00b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 --2- 172.21.15.63:0/2507505407 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b14d0 0x7f33d009aa30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 -- 172.21.15.63:0/2507505407 >> 172.21.15.63:0/2507505407 conn(0x7f33d00b3c50 msgr2=0x7f33d00b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f6e41472640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c1fd1e0 0x7f6e3c1fd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c167540 con 0x7f6e3c1fd1e0 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c06d900 con 0x7f6e3c06cde0 2024-09-17T04:23:36.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 -- 172.21.15.63:0/2507505407 shutdown_connections 2024-09-17T04:23:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f33cf59e640 1 -- 172.21.15.63:0/2507505407 wait complete. 2024-09-17T04:23:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f0f109c3640 1 -- 172.21.15.63:0/1606834038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 msgr2=0x7f0ef4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f0f109c3640 1 --2- 172.21.15.63:0/1606834038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0ef4004c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b9d0 tx=0x7f0ef4005830 comp rx=0 tx=0).stop 2024-09-17T04:23:36.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f0f0ad9d640 1 -- 172.21.15.63:0/1606834038 reap_dead start 2024-09-17T04:23:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d5848b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d50212820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d5848b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d56227640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d50212820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d56227640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d50212820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37664/0 (socket says 172.21.15.63:37664) 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d55a26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d55a26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36244/0 (socket says 172.21.15.63:36244) 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d56227640 1 -- 172.21.15.63:0/1005596141 learned_addr learned my addr 172.21.15.63:0/1005596141 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d5848b640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d500afbe0 0x7f8d500c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.301+0000 7f8d5848b640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8d500b3670 con 0x7f8d500cfb90 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d5848b640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f8d500b34f0 con 0x7f8d500afbe0 2024-09-17T04:23:36.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d5848b640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f8d500b37f0 con 0x7f8d500cf660 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d56a28640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d500afbe0 0x7f8d500c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d55a26640 1 -- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 msgr2=0x7f8d50212820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d55a26640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d50212820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d55a26640 1 -- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d500afbe0 msgr2=0x7f8d500c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d55a26640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d500afbe0 0x7f8d500c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.302+0000 7f8d55a26640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d500c8f60 con 0x7f8d500cfb90 2024-09-17T04:23:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f8d55a26640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c500 tx=0x7f8d4000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40017070 con 0x7f8d500cfb90 2024-09-17T04:23:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d400036e0 con 0x7f8d500cfb90 2024-09-17T04:23:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40003b70 con 0x7f8d500cfb90 2024-09-17T04:23:36.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f8d5848b640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5009cca0 con 0x7f8d500cfb90 2024-09-17T04:23:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 -- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 msgr2=0x7f6e3c0b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 0x7f6e3c0b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 -- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c1fd1e0 msgr2=0x7f6e3c1fd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c1fd1e0 0x7f6e3c1fd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c1fdb30 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f6e3bfff640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0cee20 tx=0x7f6e30003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f382b59e640 1 Processor -- start 2024-09-17T04:23:36.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f382b59e640 1 -- start start 2024-09-17T04:23:36.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7f116a9c3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7ff66d920640 1 Processor -- start 2024-09-17T04:23:36.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.304+0000 7ff66d920640 1 -- start start 2024-09-17T04:23:36.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3003f070 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e30004890 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c0b9db0 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c0ba370 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f8d5848b640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5009d9c0 con 0x7f8d500cfb90 2024-09-17T04:23:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f116a9c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f116415c9b0 0x7f11641fa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f116a9c3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116415ff30 0x7f1164152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f116a9c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d0640 con 0x7f116415c9b0 2024-09-17T04:23:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f116a9c3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f11640d04c0 con 0x7f116415ff30 2024-09-17T04:23:36.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f116a9c3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f11640d07c0 con 0x7f1164073e70 2024-09-17T04:23:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f0f109c3640 1 -- 172.21.15.63:0/1606834038 shutdown_connections 2024-09-17T04:23:36.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f0f109c3640 1 -- 172.21.15.63:0/1606834038 >> 172.21.15.63:0/1606834038 conn(0x7f0f0c06d7d0 msgr2=0x7f0f0c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f0f109c3640 1 -- 172.21.15.63:0/1606834038 shutdown_connections 2024-09-17T04:23:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.305+0000 7f0f109c3640 1 -- 172.21.15.63:0/1606834038 wait complete. 2024-09-17T04:23:36.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c15a740 0x7f382c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f33cf59e640 1 Processor -- start 2024-09-17T04:23:36.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7ff66d920640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6680cfcb0 0x7ff6681edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f382c147e60 0x7f382c1f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0ce2b0 con 0x7f382c15a740 2024-09-17T04:23:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f382c06f770 con 0x7f382c147e60 2024-09-17T04:23:36.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f33cf59e640 1 -- start start 2024-09-17T04:23:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f3823fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f3823fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37688/0 (socket says 172.21.15.63:37688) 2024-09-17T04:23:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f3823fff640 1 -- 172.21.15.63:0/3612178831 learned_addr learned my addr 172.21.15.63:0/3612178831 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382ad9d640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f382c147e60 0x7f382c1f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f382c165970 con 0x7f382c14b450 2024-09-17T04:23:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7ff66d920640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6680b5680 0x7ff6681fd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7ff66d920640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff66d920640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680caad0 con 0x7ff6680cfcb0 2024-09-17T04:23:36.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff66d920640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680ca950 con 0x7ff6680b5680 2024-09-17T04:23:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d500b3c50 con 0x7f8d500cfb90 2024-09-17T04:23:36.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff66d920640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680cac50 con 0x7ff6681fd9c0 2024-09-17T04:23:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37690/0 (socket says 172.21.15.63:37690) 2024-09-17T04:23:36.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 -- 172.21.15.63:0/1016440946 learned_addr learned my addr 172.21.15.63:0/1016440946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 -- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f382c147e60 msgr2=0x7f382c1f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f382c147e60 0x7f382c1f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 -- 172.21.15.63:0/3612178831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c15a740 msgr2=0x7f382c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c15a740 0x7f382c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c154620 con 0x7f382c14b450 2024-09-17T04:23:36.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.307+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30035030 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f84f168b640 1 -- 172.21.15.63:0/2990231853 shutdown_connections 2024-09-17T04:23:36.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.303+0000 7f84f168b640 1 -- 172.21.15.63:0/2990231853 wait complete. 2024-09-17T04:23:36.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f84f168b640 1 Processor -- start 2024-09-17T04:23:36.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.306+0000 7f84f168b640 1 -- start start 2024-09-17T04:23:36.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c0b7cc0 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f3823fff640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3814001ea0 tx=0x7f381400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f0f109c3640 1 Processor -- start 2024-09-17T04:23:36.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 -- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6680b5680 msgr2=0x7ff6681fd480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:36.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f0f109c3640 1 -- start start 2024-09-17T04:23:36.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38140052d0 con 0x7f382c14b450 2024-09-17T04:23:36.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3814011830 con 0x7f382c14b450 2024-09-17T04:23:36.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6680b5680 0x7ff6681fd480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c14add0 con 0x7f382c14b450 2024-09-17T04:23:36.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 -- 172.21.15.63:0/1016440946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6680cfcb0 msgr2=0x7ff6681edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814011c80 con 0x7f382c14b450 2024-09-17T04:23:36.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6680cfcb0 0x7ff6681edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c14bc60 con 0x7f382c14b450 2024-09-17T04:23:36.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7ff6677fe640 1 -- 172.21.15.63:0/1016440946 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6681fddd0 con 0x7ff6681fd9c0 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d4001a070 con 0x7f8d500cfb90 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f8d46ffd640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 0x7f8d3407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d4009a140 con 0x7f8d500cfb90 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f1163fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f1163fff640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37700/0 (socket says 172.21.15.63:37700) 2024-09-17T04:23:36.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f1163fff640 1 -- 172.21.15.63:0/4085113798 learned_addr learned my addr 172.21.15.63:0/4085113798 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f33cf59e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 0x7f33d00c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cf59e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 -- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116415ff30 msgr2=0x7f1164152fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116415ff30 0x7f1164152fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 -- 172.21.15.63:0/4085113798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f116415c9b0 msgr2=0x7f11641fa3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T04:23:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cf59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 0x7f33d01e9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f116415c9b0 0x7f11641fa3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 -- 172.21.15.63:0/4085113798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11641fd9b0 con 0x7f1164073e70 2024-09-17T04:23:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cdd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cdd9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:46392/0 (socket says 172.21.15.63:46392) 2024-09-17T04:23:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cdd9b640 1 -- 172.21.15.63:0/3203956378 learned_addr learned my addr 172.21.15.63:0/3203956378 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b2a60 con 0x7f33d00b7590 2024-09-17T04:23:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1163fff640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f115400c370 tx=0x7f115400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f84f168b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 0x7f84ec0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f84f168b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f84f168b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84ec0c6080 0x7f84ec0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.308+0000 7f84f168b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec0d0040 con 0x7f84ec0c6080 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84f168b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec0cfec0 con 0x7f84ec071330 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84f168b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f84ec0d01c0 con 0x7f84ec155c70 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84ea7fc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:37694/0 (socket says 172.21.15.63:37694) 2024-09-17T04:23:36.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84ea7fc640 1 -- 172.21.15.63:0/3080949653 learned_addr learned my addr 172.21.15.63:0/3080949653 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.309+0000 7f84ea7fc640 1 -- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 msgr2=0x7f84ec0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84eaffd640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 0x7f84ec0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84ea7fc640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 0x7f84ec0afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84ea7fc640 1 -- 172.21.15.63:0/3080949653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84ec0c6080 msgr2=0x7f84ec0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84ea7fc640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84ec0c6080 0x7f84ec0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84ea7fc640 1 -- 172.21.15.63:0/3080949653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec154870 con 0x7f84ec155c70 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b28e0 con 0x7f33d00b1f90 2024-09-17T04:23:36.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154017070 con 0x7f1164073e70 2024-09-17T04:23:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.310+0000 7f84eaffd640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 0x7f84ec0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11540053c0 con 0x7f1164073e70 2024-09-17T04:23:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f84ea7fc640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f84e000c430 tx=0x7f84e000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e30042070 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f116a9c3640 1 -- 172.21.15.63:0/4085113798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11641fdc90 con 0x7f1164073e70 2024-09-17T04:23:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f116a9c3640 1 -- 172.21.15.63:0/4085113798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11640b5b50 con 0x7f1164073e70 2024-09-17T04:23:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f33d00b2be0 con 0x7f33d00b14d0 2024-09-17T04:23:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0017070 con 0x7f84ec155c70 2024-09-17T04:23:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154003850 con 0x7f1164073e70 2024-09-17T04:23:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f0f109c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f0f0a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f0f0a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36318/0 (socket says 172.21.15.63:36318) 2024-09-17T04:23:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f6e397fa640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 0x7f6e2807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f0f0a59c640 1 -- 172.21.15.63:0/3190571479 learned_addr learned my addr 172.21.15.63:0/3190571479 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f0c155b90 0x7f0f0c1f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f6e40c71640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 0x7f6e2807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f0c1f9b90 0x7f0f0c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6e300bbbf0 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f0f09d9b640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f0c155b90 0x7f0f0c1f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38140035f0 con 0x7f382c14b450 2024-09-17T04:23:36.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f8d56227640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 0x7f8d3407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f3822ffd640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 0x7f380c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f6e40c71640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 0x7f6e2807b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005fd0 tx=0x7f6e2c00a4e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7ff6677fe640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff65800caa0 tx=0x7ff65800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658016020 con 0x7ff6681fd9c0 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff65800ac90 con 0x7ff6681fd9c0 2024-09-17T04:23:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658012680 con 0x7ff6681fd9c0 2024-09-17T04:23:36.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f381409e470 con 0x7f382c14b450 2024-09-17T04:23:36.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84e00053c0 con 0x7f84ec155c70 2024-09-17T04:23:36.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0017070 con 0x7f84ec155c70 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.311+0000 7f33ce59c640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 0x7f33d00c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f33ced9d640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 0x7f33d01e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f382a59c640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 0x7f380c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3810005290 con 0x7f382c14b450 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.312+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6680b0cd0 con 0x7ff6681fd9c0 2024-09-17T04:23:36.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6680b1290 con 0x7ff6681fd9c0 2024-09-17T04:23:36.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f116a9c3640 1 -- 172.21.15.63:0/4085113798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11641f99e0 con 0x7f1164073e70 2024-09-17T04:23:36.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c15fca0 con 0x7f0ef4004800 2024-09-17T04:23:36.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c15fb20 con 0x7f0f0c155b90 2024-09-17T04:23:36.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0c15fe20 con 0x7f0f0c1f9b90 2024-09-17T04:23:36.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f0f0ad9d640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f0c1f9b90 0x7f0f0c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.313+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ec0c6c40 con 0x7f84ec155c70 2024-09-17T04:23:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ec0cbd30 con 0x7f84ec155c70 2024-09-17T04:23:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f115401a070 con 0x7f1164073e70 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 -- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 msgr2=0x7f33d00c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 0x7f33d00c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 -- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 msgr2=0x7f33d00b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d00c9f20 con 0x7f33d00b7590 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ce59c640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 0x7f33d00c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33cdd9b640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66815a490 con 0x7ff6681fd9c0 2024-09-17T04:23:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f0f0a59c640 1 -- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f0c1f9b90 msgr2=0x7f0f0c156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f1160ff9640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 0x7f115007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f33ced9d640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 0x7f33d01e9420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33d00742f0 tx=0x7f33c800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f0f0a59c640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f0c1f9b90 0x7f0f0c156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1154099e70 con 0x7f1164073e70 2024-09-17T04:23:36.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f0f0a59c640 1 -- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f0c155b90 msgr2=0x7f0f0c1f9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f0f0a59c640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f0c155b90 0x7f0f0c1f9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.314+0000 7f0f0a59c640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c1f9fa0 con 0x7f0ef4004800 2024-09-17T04:23:36.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f11637fe640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 0x7f115007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f8d56227640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 0x7f8d3407b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005f60 tx=0x7f8d4c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f0f0a59c640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0066e0 tx=0x7f0efc001840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f382a59c640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 0x7f380c07b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f381c001510 tx=0x7f381c007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ec0739a0 con 0x7f84ec155c70 2024-09-17T04:23:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7f11637fe640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 0x7f115007b120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f116415f240 tx=0x7f115c0095c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.315+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff658019020 con 0x7ff6681fd9c0 2024-09-17T04:23:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.316+0000 7ff64ffff640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 0x7ff65407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.316+0000 7ff666ffd640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 0x7ff65407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.317+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d40061fa0 con 0x7f8d500cfb90 2024-09-17T04:23:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.317+0000 7ff666ffd640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 0x7ff65407b120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff6600046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.319+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff6580998d0 con 0x7ff6681fd9c0 2024-09-17T04:23:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.319+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f382c14add0 con 0x7f382c14b450 2024-09-17T04:23:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.321+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84e001a070 con 0x7f84ec155c70 2024-09-17T04:23:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc015070 con 0x7f0ef4004800 2024-09-17T04:23:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0efc011920 con 0x7f0ef4004800 2024-09-17T04:23:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c159850 con 0x7f0ef4004800 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.321+0000 7f84d37fe640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 0x7f84d807b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc011d70 con 0x7f0ef4004800 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.321+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c800cd50 con 0x7f33d00b7590 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33c8004b20 con 0x7f33d00b7590 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8005020 con 0x7f33d00b7590 2024-09-17T04:23:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d01f3520 con 0x7f33d00b7590 2024-09-17T04:23:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e3c1fdb30 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f84eaffd640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 0x7f84d807b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.322+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01f3ae0 con 0x7f33d00b7590 2024-09-17T04:23:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.323+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c0aedd0 con 0x7f0ef4004800 2024-09-17T04:23:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c0ccc80 con 0x7f0ef4004800 2024-09-17T04:23:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11640747c0 con 0x7f1164073e70 2024-09-17T04:23:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0efc018070 con 0x7f0ef4004800 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.324+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d00b06f0 con 0x7f33d00b7590 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33c80051c0 con 0x7f33d00b7590 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f33beffd640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 0x7f33b007f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.326+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33c809ba80 con 0x7f33d00b7590 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.325+0000 7f84eaffd640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 0x7f84d807b4a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84e4035000 tx=0x7f84e4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.326+0000 7f0efaffd640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 0x7f0eec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.326+0000 7f33ce59c640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 0x7f33b007f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.326+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0efc09bc10 con 0x7f0ef4004800 2024-09-17T04:23:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.326+0000 7f0f09d9b640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 0x7f0eec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.327+0000 7f33ce59c640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 0x7f33b007f4b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33c0033000 tx=0x7f33c000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.327+0000 7f0f09d9b640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 0x7f0eec07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036000 tx=0x7f0f000046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.329+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84e00050d0 con 0x7f84ec155c70 2024-09-17T04:23:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.329+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff66815a490 con 0x7ff6681fd9c0 2024-09-17T04:23:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.331+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33c8063e30 con 0x7f33d00b7590 2024-09-17T04:23:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.336+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84ec0739a0 con 0x7f84ec155c70 2024-09-17T04:23:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.340+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f0c1f9fa0 con 0x7f0ef4004800 2024-09-17T04:23:36.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.748+0000 7f116a9c3640 1 -- 172.21.15.63:0/4085113798 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1164071810 con 0x7f1164073e70 2024-09-17T04:23:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.749+0000 7f1160ff9640 1 -- 172.21.15.63:0/4085113798 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f11540624b0 con 0x7f1164073e70 2024-09-17T04:23:36.749 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.752+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8d500c93d0 con 0x7f8d500cfb90 2024-09-17T04:23:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.752+0000 7f8d46ffd640 1 -- 172.21.15.63:0/1005596141 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d400669d0 con 0x7f8d500cfb90 2024-09-17T04:23:36.752 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-17T04:23:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 msgr2=0x7f115007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 0x7f115007b120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f116415f240 tx=0x7f115c0095c0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 msgr2=0x7f11641fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f115400c370 tx=0x7f115400c830 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 shutdown_connections 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1150078c10 0x7f115007b120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f116415ff30 0x7f1164152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.753+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f116415c9b0 0x7f11641fa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.754+0000 7f114a7fc640 1 --2- 172.21.15.63:0/4085113798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f1164073e70 0x7f11641fcfd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.754+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 >> 172.21.15.63:0/4085113798 conn(0x7f11640cdc60 msgr2=0x7f11640cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.754+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 shutdown_connections 2024-09-17T04:23:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.754+0000 7f114a7fc640 1 -- 172.21.15.63:0/4085113798 wait complete. 2024-09-17T04:23:36.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3810005580 con 0x7f382c14b450 2024-09-17T04:23:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 msgr2=0x7f8d3407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 0x7f8d3407b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005f60 tx=0x7f8d4c005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 msgr2=0x7f8d5009d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000c500 tx=0x7f8d4000c9c0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f3822ffd640 1 -- 172.21.15.63:0/3612178831 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38140669b0 con 0x7f382c14b450 2024-09-17T04:23:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 shutdown_connections 2024-09-17T04:23:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f8d34078c60 0x7f8d3407b170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f8d500afbe0 0x7f8d500c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d500cfb90 0x7f8d5009d480 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 --2- 172.21.15.63:0/1005596141 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f8d500cf660 0x7f8d50212820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.756+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 >> 172.21.15.63:0/1005596141 conn(0x7f8d500b1cb0 msgr2=0x7f8d500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.757+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 shutdown_connections 2024-09-17T04:23:36.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.757+0000 7f8d44ff9640 1 -- 172.21.15.63:0/1005596141 wait complete. 2024-09-17T04:23:36.759 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.760+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 msgr2=0x7f380c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.760+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 0x7f380c07b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f381c001510 tx=0x7f381c007930 comp rx=0 tx=0).stop 2024-09-17T04:23:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.758+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6e3c0baa30 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.760+0000 7f6e397fa640 1 -- 172.21.15.63:0/3731718798 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e3c0c4bc0 con 0x7f6e3c1fdda0 2024-09-17T04:23:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.760+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 msgr2=0x7f382c147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.760+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3814001ea0 tx=0x7f381400c8f0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 shutdown_connections 2024-09-17T04:23:36.761 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f380c078bc0 0x7f380c07b0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f382c147e60 0x7f382c1f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f382c14b450 0x7f382c147920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 --2- 172.21.15.63:0/3612178831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f382c15a740 0x7f382c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 >> 172.21.15.63:0/3612178831 conn(0x7f382c06d4a0 msgr2=0x7f382c149090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 shutdown_connections 2024-09-17T04:23:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.761+0000 7f382b59e640 1 -- 172.21.15.63:0/3612178831 wait complete. 2024-09-17T04:23:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.764+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f33d0071240 con 0x7f33d00b7590 2024-09-17T04:23:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.764+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff668073160 con 0x7ff6681fd9c0 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.764+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 msgr2=0x7f6e2807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.764+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 0x7f6e2807b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005fd0 tx=0x7f6e2c00a4e0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.764+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 msgr2=0x7f6e3c166460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0cee20 tx=0x7f6e30003c00 comp rx=0 tx=0).stop 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 shutdown_connections 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6e28078c90 0x7f6e2807b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e3c1fd1e0 0x7f6e3c1fd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7ff64ffff640 1 -- 172.21.15.63:0/1016440946 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff658020020 con 0x7ff6681fd9c0 2024-09-17T04:23:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e3c1fdda0 0x7f6e3c166460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 --2- 172.21.15.63:0/3731718798 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e3c06cde0 0x7f6e3c0b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 >> 172.21.15.63:0/3731718798 conn(0x7f6e3c0d12a0 msgr2=0x7f6e3c1627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 shutdown_connections 2024-09-17T04:23:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f6e42ed5640 1 -- 172.21.15.63:0/3731718798 wait complete. 2024-09-17T04:23:36.767 INFO:teuthology.orchestra.run.smithi063.stdout:55834574855 2024-09-17T04:23:36.767 INFO:teuthology.orchestra.run.smithi063.stdout:55834574855 2024-09-17T04:23:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.765+0000 7f33beffd640 1 -- 172.21.15.63:0/3203956378 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33c8063730 con 0x7f33d00b7590 2024-09-17T04:23:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.769+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 msgr2=0x7f33b007f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.769+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 0x7f33b007f4b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33c0033000 tx=0x7f33c000b040 comp rx=0 tx=0).stop 2024-09-17T04:23:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.769+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 msgr2=0x7ff65407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.769+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 0x7ff65407b120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff660034000 tx=0x7ff6600046c0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.769+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 msgr2=0x7ff6680b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff65800caa0 tx=0x7ff65800cf60 comp rx=0 tx=0).stop 2024-09-17T04:23:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 msgr2=0x7f33d01e9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 0x7f33d01e9420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33d00742f0 tx=0x7f33c800ee40 comp rx=0 tx=0).stop 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 shutdown_connections 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f33b007cfa0 0x7f33b007f4b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f33d00b1f90 0x7f33d00b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 shutdown_connections 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff654078c10 0x7ff65407b120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff6680b5680 0x7ff6681fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f84ec0c69d0 con 0x7f84ec155c70 2024-09-17T04:23:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff6681fd9c0 0x7ff6680b1d70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 --2- 172.21.15.63:0/1016440946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6680cfcb0 0x7ff6681edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 >> 172.21.15.63:0/1016440946 conn(0x7ff66806d870 msgr2=0x7ff66815cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33d00b7590 0x7f33d01e9420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 --2- 172.21.15.63:0/3203956378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f33d00b14d0 0x7f33d00c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 >> 172.21.15.63:0/3203956378 conn(0x7f33d00b3c50 msgr2=0x7f33d00cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.770+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 shutdown_connections 2024-09-17T04:23:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.771+0000 7ff66d920640 1 -- 172.21.15.63:0/1016440946 wait complete. 2024-09-17T04:23:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.771+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 shutdown_connections 2024-09-17T04:23:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.771+0000 7f33cf59e640 1 -- 172.21.15.63:0/3203956378 wait complete. 2024-09-17T04:23:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.771+0000 7f84d37fe640 1 -- 172.21.15.63:0/3080949653 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84e0021070 con 0x7f84ec155c70 2024-09-17T04:23:36.775 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.773+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0f0c0750f0 con 0x7f0ef4004800 2024-09-17T04:23:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.774+0000 7f0efaffd640 1 -- 172.21.15.63:0/3190571479 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0efc0638e0 con 0x7f0ef4004800 2024-09-17T04:23:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 msgr2=0x7f84d807b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 0x7f84d807b4a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84e4035000 tx=0x7f84e4004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 msgr2=0x7f84ec0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f84e000c430 tx=0x7f84e000c8f0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 shutdown_connections 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f84d8078f90 0x7f84d807b4a0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84e4035000 tx=0x7f84e4004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84ec0c6080 0x7f84ec0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f84ec155c70 0x7f84ec0cc810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 --2- 172.21.15.63:0/3080949653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f84ec071330 0x7f84ec0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.775+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 >> 172.21.15.63:0/3080949653 conn(0x7f84ec0b2e10 msgr2=0x7f84ec0b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.776 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-17T04:23:36.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 shutdown_connections 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f84f168b640 1 -- 172.21.15.63:0/3080949653 wait complete. 2024-09-17T04:23:36.778 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 msgr2=0x7f0eec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 0x7f0eec07b0d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f00036000 tx=0x7f0f000046c0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 msgr2=0x7f0f0c159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.777+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0066e0 tx=0x7f0efc001840 comp rx=0 tx=0).stop 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 shutdown_connections 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0eec078bc0 0x7f0eec07b0d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0f0c155b90 0x7f0f0c1f9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0f0c1f9b90 0x7f0f0c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 --2- 172.21.15.63:0/3190571479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ef4004800 0x7f0f0c159310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 >> 172.21.15.63:0/3190571479 conn(0x7f0f0c06d7d0 msgr2=0x7f0f0c160940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-17T04:23:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 shutdown_connections 2024-09-17T04:23:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.778+0000 7f0f109c3640 1 -- 172.21.15.63:0/3190571479 wait complete. 2024-09-17T04:23:36.780 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2024-09-17T04:23:36.785 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-17T04:23:36.792 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-17T04:23:36.792 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-09-17T04:23:36.793 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-17T04:23:36.794 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-17T04:23:36.795 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:36.795 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:23:36.795 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 -- 172.21.15.63:0/4018939615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 msgr2=0x7f82c80d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 --2- 172.21.15.63:0/4018939615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c80d0d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009830 tx=0x7f82bc02a510 comp rx=0 tx=0).stop 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 -- 172.21.15.63:0/4018939615 shutdown_connections 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 --2- 172.21.15.63:0/4018939615 >> v2:172.21.15.112:3300/0 conn(0x7f82c80d12c0 0x7f82c80d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 --2- 172.21.15.63:0/4018939615 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c80d0d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 -- 172.21.15.63:0/4018939615 >> 172.21.15.63:0/4018939615 conn(0x7f82c8072ae0 msgr2=0x7f82c8072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 -- 172.21.15.63:0/4018939615 shutdown_connections 2024-09-17T04:23:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.951+0000 7f82cd394640 1 -- 172.21.15.63:0/4018939615 wait complete. 2024-09-17T04:23:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.953+0000 7f82cd394640 1 Processor -- start 2024-09-17T04:23:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.953+0000 7f82cd394640 1 -- start start 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c815af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80d12c0 0x7f82c8152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80cf220 con 0x7f82c80b51c0 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f82c80cf0a0 con 0x7f82c80d12c0 2024-09-17T04:23:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82cd394640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80cf3a0 con 0x7f82c80ccbd0 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36322/0 (socket says 172.21.15.63:36322) 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 -- 172.21.15.63:0/2974738459 learned_addr learned my addr 172.21.15.63:0/2974738459 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c67fc640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c77fe640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80d12c0 0x7f82c8152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 -- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 msgr2=0x7f82c815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 -- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80d12c0 msgr2=0x7f82c8152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80d12c0 0x7f82c8152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.954+0000 7f82c6ffd640 1 -- 172.21.15.63:0/2974738459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80cb170 con 0x7f82c80b51c0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82c6ffd640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c3d0 tx=0x7f82b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8017070 con 0x7f82c80b51c0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82b80053c0 con 0x7f82c80b51c0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8003850 con 0x7f82c80b51c0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c8152cc0 con 0x7f82c80b51c0 2024-09-17T04:23:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.955+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c80cb710 con 0x7f82c80b51c0 2024-09-17T04:23:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.956+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c80cf850 con 0x7f82c80b51c0 2024-09-17T04:23:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.957+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82b801a070 con 0x7f82c80b51c0 2024-09-17T04:23:36.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.957+0000 7f82af7fe640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.957+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f82b8099f70 con 0x7f82c80b51c0 2024-09-17T04:23:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.957+0000 7f82c67fc640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:36.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.958+0000 7f82c67fc640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 0x7f82b407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034000 tx=0x7f82bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:36.962+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82b8061e80 con 0x7f82c80b51c0 2024-09-17T04:23:37.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.145+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82c80b7b70 con 0x7f82b4078b90 2024-09-17T04:23:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.150+0000 7f82af7fe640 1 -- 172.21.15.63:0/2974738459 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f82c80b7b70 con 0x7f82b4078b90 2024-09-17T04:23:37.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:37.154 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:37.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 msgr2=0x7f82b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 0x7f82b407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034000 tx=0x7f82bc004730 comp rx=0 tx=0).stop 2024-09-17T04:23:37.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 msgr2=0x7f82c80a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82b800c3d0 tx=0x7f82b800c890 comp rx=0 tx=0).stop 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 shutdown_connections 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f82b4078b90 0x7f82b407b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f82c80d12c0 0x7f82c8152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f82c80ccbd0 0x7f82c815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 --2- 172.21.15.63:0/2974738459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82c80b51c0 0x7f82c80a9db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 >> 172.21.15.63:0/2974738459 conn(0x7f82c8072ae0 msgr2=0x7f82c80b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 shutdown_connections 2024-09-17T04:23:37.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.154+0000 7f82cd394640 1 -- 172.21.15.63:0/2974738459 wait complete. 2024-09-17T04:23:37.165 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T04:23:36.401086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.042669"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659274+0000","last_change":"2024-09-17T04:23:25.376557+0000","last_active":"2024-09-17T04:23:26.659274+0000","last_peered":"2024-09-17T04:23:26.659274+0000","last_clean":"2024-09-17T04:23:26.659274+0000","last_became_active":"2024-09-17T04:23:25.376196+0000","last_became_peered":"2024-09-17T04:23:25.376196+0000","last_unstale":"2024-09-17T04:23:26.659274+0000","last_undegraded":"2024-09-17T04:23:26.659274+0000","last_fullsized":"2024-09-17T04:23:26.659274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:31.126084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657398+0000","last_change":"2024-09-17T04:23:25.357621+0000","last_active":"2024-09-17T04:23:26.657398+0000","last_peered":"2024-09-17T04:23:26.657398+0000","last_clean":"2024-09-17T04:23:26.657398+0000","last_became_active":"2024-09-17T04:23:25.355965+0000","last_became_peered":"2024-09-17T04:23:25.355965+0000","last_unstale":"2024-09-17T04:23:26.657398+0000","last_undegraded":"2024-09-17T04:23:26.657398+0000","last_fullsized":"2024-09-17T04:23:26.657398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659057+0000","last_change":"2024-09-17T04:23:25.373604+0000","last_active":"2024-09-17T04:23:26.659057+0000","last_peered":"2024-09-17T04:23:26.659057+0000","last_clean":"2024-09-17T04:23:26.659057+0000","last_became_active":"2024-09-17T04:23:25.373309+0000","last_became_peered":"2024-09-17T04:23:25.373309+0000","last_unstale":"2024-09-17T04:23:26.659057+0000","last_undegraded":"2024-09-17T04:23:26.659057+0000","last_fullsized":"2024-09-17T04:23:26.659057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658926+0000","last_change":"2024-09-17T04:23:25.379332+0000","last_active":"2024-09-17T04:23:26.658926+0000","last_peered":"2024-09-17T04:23:26.658926+0000","last_clean":"2024-09-17T04:23:26.658926+0000","last_became_active":"2024-09-17T04:23:25.377519+0000","last_became_peered":"2024-09-17T04:23:25.377519+0000","last_unstale":"2024-09-17T04:23:26.658926+0000","last_undegraded":"2024-09-17T04:23:26.658926+0000","last_fullsized":"2024-09-17T04:23:26.658926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:14.203036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656178+0000","last_change":"2024-09-17T04:23:25.381475+0000","last_active":"2024-09-17T04:23:26.656178+0000","last_peered":"2024-09-17T04:23:26.656178+0000","last_clean":"2024-09-17T04:23:26.656178+0000","last_became_active":"2024-09-17T04:23:25.381163+0000","last_became_peered":"2024-09-17T04:23:25.381163+0000","last_unstale":"2024-09-17T04:23:26.656178+0000","last_undegraded":"2024-09-17T04:23:26.656178+0000","last_fullsized":"2024-09-17T04:23:26.656178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659283+0000","last_change":"2024-09-17T04:23:25.373332+0000","last_active":"2024-09-17T04:23:26.659283+0000","last_peered":"2024-09-17T04:23:26.659283+0000","last_clean":"2024-09-17T04:23:26.659283+0000","last_became_active":"2024-09-17T04:23:25.372980+0000","last_became_peered":"2024-09-17T04:23:25.372980+0000","last_unstale":"2024-09-17T04:23:26.659283+0000","last_undegraded":"2024-09-17T04:23:26.659283+0000","last_fullsized":"2024-09-17T04:23:26.659283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.403052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468977+0000","last_change":"2024-09-17T04:23:25.365489+0000","last_active":"2024-09-17T04:23:26.468977+0000","last_peered":"2024-09-17T04:23:26.468977+0000","last_clean":"2024-09-17T04:23:26.468977+0000","last_became_active":"2024-09-17T04:23:25.365166+0000","last_became_peered":"2024-09-17T04:23:25.365166+0000","last_unstale":"2024-09-17T04:23:26.468977+0000","last_undegraded":"2024-09-17T04:23:26.468977+0000","last_fullsized":"2024-09-17T04:23:26.468977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468815+0000","last_change":"2024-09-17T04:23:25.369673+0000","last_active":"2024-09-17T04:23:26.468815+0000","last_peered":"2024-09-17T04:23:26.468815+0000","last_clean":"2024-09-17T04:23:26.468815+0000","last_became_active":"2024-09-17T04:23:25.369360+0000","last_became_peered":"2024-09-17T04:23:25.369360+0000","last_unstale":"2024-09-17T04:23:26.468815+0000","last_undegraded":"2024-09-17T04:23:26.468815+0000","last_fullsized":"2024-09-17T04:23:26.468815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360528+0000","last_change":"2024-09-17T04:23:25.365165+0000","last_active":"2024-09-17T04:23:26.360528+0000","last_peered":"2024-09-17T04:23:26.360528+0000","last_clean":"2024-09-17T04:23:26.360528+0000","last_became_active":"2024-09-17T04:23:25.364840+0000","last_became_peered":"2024-09-17T04:23:25.364840+0000","last_unstale":"2024-09-17T04:23:26.360528+0000","last_undegraded":"2024-09-17T04:23:26.360528+0000","last_fullsized":"2024-09-17T04:23:26.360528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657001+0000","last_change":"2024-09-17T04:23:25.363017+0000","last_active":"2024-09-17T04:23:26.657001+0000","last_peered":"2024-09-17T04:23:26.657001+0000","last_clean":"2024-09-17T04:23:26.657001+0000","last_became_active":"2024-09-17T04:23:25.362696+0000","last_became_peered":"2024-09-17T04:23:25.362696+0000","last_unstale":"2024-09-17T04:23:26.657001+0000","last_undegraded":"2024-09-17T04:23:26.657001+0000","last_fullsized":"2024-09-17T04:23:26.657001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:29.184786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656448+0000","last_change":"2024-09-17T04:23:25.366854+0000","last_active":"2024-09-17T04:23:26.656448+0000","last_peered":"2024-09-17T04:23:26.656448+0000","last_clean":"2024-09-17T04:23:26.656448+0000","last_became_active":"2024-09-17T04:23:25.366508+0000","last_became_peered":"2024-09-17T04:23:25.366508+0000","last_unstale":"2024-09-17T04:23:26.656448+0000","last_undegraded":"2024-09-17T04:23:26.656448+0000","last_fullsized":"2024-09-17T04:23:26.656448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:55.579822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656798+0000","last_change":"2024-09-17T04:23:25.363990+0000","last_active":"2024-09-17T04:23:26.656798+0000","last_peered":"2024-09-17T04:23:26.656798+0000","last_clean":"2024-09-17T04:23:26.656798+0000","last_became_active":"2024-09-17T04:23:25.363609+0000","last_became_peered":"2024-09-17T04:23:25.363609+0000","last_unstale":"2024-09-17T04:23:26.656798+0000","last_undegraded":"2024-09-17T04:23:26.656798+0000","last_fullsized":"2024-09-17T04:23:26.656798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659347+0000","last_change":"2024-09-17T04:23:25.372922+0000","last_active":"2024-09-17T04:23:26.659347+0000","last_peered":"2024-09-17T04:23:26.659347+0000","last_clean":"2024-09-17T04:23:26.659347+0000","last_became_active":"2024-09-17T04:23:25.372597+0000","last_became_peered":"2024-09-17T04:23:25.372597+0000","last_unstale":"2024-09-17T04:23:26.659347+0000","last_undegraded":"2024-09-17T04:23:26.659347+0000","last_fullsized":"2024-09-17T04:23:26.659347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:46.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468848+0000","last_change":"2024-09-17T04:23:25.369858+0000","last_active":"2024-09-17T04:23:26.468848+0000","last_peered":"2024-09-17T04:23:26.468848+0000","last_clean":"2024-09-17T04:23:26.468848+0000","last_became_active":"2024-09-17T04:23:25.369523+0000","last_became_peered":"2024-09-17T04:23:25.369523+0000","last_unstale":"2024-09-17T04:23:26.468848+0000","last_undegraded":"2024-09-17T04:23:26.468848+0000","last_fullsized":"2024-09-17T04:23:26.468848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657526+0000","last_change":"2024-09-17T04:23:25.372496+0000","last_active":"2024-09-17T04:23:26.657526+0000","last_peered":"2024-09-17T04:23:26.657526+0000","last_clean":"2024-09-17T04:23:26.657526+0000","last_became_active":"2024-09-17T04:23:25.371988+0000","last_became_peered":"2024-09-17T04:23:25.371988+0000","last_unstale":"2024-09-17T04:23:26.657526+0000","last_undegraded":"2024-09-17T04:23:26.657526+0000","last_fullsized":"2024-09-17T04:23:26.657526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656520+0000","last_change":"2024-09-17T04:23:25.370154+0000","last_active":"2024-09-17T04:23:26.656520+0000","last_peered":"2024-09-17T04:23:26.656520+0000","last_clean":"2024-09-17T04:23:26.656520+0000","last_became_active":"2024-09-17T04:23:25.369846+0000","last_became_peered":"2024-09-17T04:23:25.369846+0000","last_unstale":"2024-09-17T04:23:26.656520+0000","last_undegraded":"2024-09-17T04:23:26.656520+0000","last_fullsized":"2024-09-17T04:23:26.656520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656790+0000","last_change":"2024-09-17T04:23:25.374875+0000","last_active":"2024-09-17T04:23:26.656790+0000","last_peered":"2024-09-17T04:23:26.656790+0000","last_clean":"2024-09-17T04:23:26.656790+0000","last_became_active":"2024-09-17T04:23:25.374565+0000","last_became_peered":"2024-09-17T04:23:25.374565+0000","last_unstale":"2024-09-17T04:23:26.656790+0000","last_undegraded":"2024-09-17T04:23:26.656790+0000","last_fullsized":"2024-09-17T04:23:26.656790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468983+0000","last_change":"2024-09-17T04:23:25.371408+0000","last_active":"2024-09-17T04:23:26.468983+0000","last_peered":"2024-09-17T04:23:26.468983+0000","last_clean":"2024-09-17T04:23:26.468983+0000","last_became_active":"2024-09-17T04:23:25.371085+0000","last_became_peered":"2024-09-17T04:23:25.371085+0000","last_unstale":"2024-09-17T04:23:26.468983+0000","last_undegraded":"2024-09-17T04:23:26.468983+0000","last_fullsized":"2024-09-17T04:23:26.468983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.992287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657086+0000","last_change":"2024-09-17T04:23:25.370366+0000","last_active":"2024-09-17T04:23:26.657086+0000","last_peered":"2024-09-17T04:23:26.657086+0000","last_clean":"2024-09-17T04:23:26.657086+0000","last_became_active":"2024-09-17T04:23:25.369986+0000","last_became_peered":"2024-09-17T04:23:25.369986+0000","last_unstale":"2024-09-17T04:23:26.657086+0000","last_undegraded":"2024-09-17T04:23:26.657086+0000","last_fullsized":"2024-09-17T04:23:26.657086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657687+0000","last_change":"2024-09-17T04:23:25.363653+0000","last_active":"2024-09-17T04:23:26.657687+0000","last_peered":"2024-09-17T04:23:26.657687+0000","last_clean":"2024-09-17T04:23:26.657687+0000","last_became_active":"2024-09-17T04:23:25.363060+0000","last_became_peered":"2024-09-17T04:23:25.363060+0000","last_unstale":"2024-09-17T04:23:26.657687+0000","last_undegraded":"2024-09-17T04:23:26.657687+0000","last_fullsized":"2024-09-17T04:23:26.657687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656912+0000","last_change":"2024-09-17T04:23:25.365226+0000","last_active":"2024-09-17T04:23:26.656912+0000","last_peered":"2024-09-17T04:23:26.656912+0000","last_clean":"2024-09-17T04:23:26.656912+0000","last_became_active":"2024-09-17T04:23:25.364858+0000","last_became_peered":"2024-09-17T04:23:25.364858+0000","last_unstale":"2024-09-17T04:23:26.656912+0000","last_undegraded":"2024-09-17T04:23:26.656912+0000","last_fullsized":"2024-09-17T04:23:26.656912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468547+0000","last_change":"2024-09-17T04:23:25.363571+0000","last_active":"2024-09-17T04:23:26.468547+0000","last_peered":"2024-09-17T04:23:26.468547+0000","last_clean":"2024-09-17T04:23:26.468547+0000","last_became_active":"2024-09-17T04:23:25.363235+0000","last_became_peered":"2024-09-17T04:23:25.363235+0000","last_unstale":"2024-09-17T04:23:26.468547+0000","last_undegraded":"2024-09-17T04:23:26.468547+0000","last_fullsized":"2024-09-17T04:23:26.468547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360260+0000","last_change":"2024-09-17T04:23:25.363674+0000","last_active":"2024-09-17T04:23:26.360260+0000","last_peered":"2024-09-17T04:23:26.360260+0000","last_clean":"2024-09-17T04:23:26.360260+0000","last_became_active":"2024-09-17T04:23:25.363334+0000","last_became_peered":"2024-09-17T04:23:25.363334+0000","last_unstale":"2024-09-17T04:23:26.360260+0000","last_undegraded":"2024-09-17T04:23:26.360260+0000","last_fullsized":"2024-09-17T04:23:26.360260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.913452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657300+0000","last_change":"2024-09-17T04:23:24.353312+0000","last_active":"2024-09-17T04:23:26.657300+0000","last_peered":"2024-09-17T04:23:26.657300+0000","last_clean":"2024-09-17T04:23:26.657300+0000","last_became_active":"2024-09-17T04:23:24.352973+0000","last_became_peered":"2024-09-17T04:23:24.352973+0000","last_unstale":"2024-09-17T04:23:26.657300+0000","last_undegraded":"2024-09-17T04:23:26.657300+0000","last_fullsized":"2024-09-17T04:23:26.657300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:00.251669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657690+0000","last_change":"2024-09-17T04:23:25.367192+0000","last_active":"2024-09-17T04:23:26.657690+0000","last_peered":"2024-09-17T04:23:26.657690+0000","last_clean":"2024-09-17T04:23:26.657690+0000","last_became_active":"2024-09-17T04:23:25.366787+0000","last_became_peered":"2024-09-17T04:23:25.366787+0000","last_unstale":"2024-09-17T04:23:26.657690+0000","last_undegraded":"2024-09-17T04:23:26.657690+0000","last_fullsized":"2024-09-17T04:23:26.657690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468424+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.468424+0000","last_peered":"2024-09-17T04:23:26.468424+0000","last_clean":"2024-09-17T04:23:26.468424+0000","last_became_active":"2024-09-17T04:23:24.353296+0000","last_became_peered":"2024-09-17T04:23:24.353296+0000","last_unstale":"2024-09-17T04:23:26.468424+0000","last_undegraded":"2024-09-17T04:23:26.468424+0000","last_fullsized":"2024-09-17T04:23:26.468424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656443+0000","last_change":"2024-09-17T04:23:24.354209+0000","last_active":"2024-09-17T04:23:26.656443+0000","last_peered":"2024-09-17T04:23:26.656443+0000","last_clean":"2024-09-17T04:23:26.656443+0000","last_became_active":"2024-09-17T04:23:24.353857+0000","last_became_peered":"2024-09-17T04:23:24.353857+0000","last_unstale":"2024-09-17T04:23:26.656443+0000","last_undegraded":"2024-09-17T04:23:26.656443+0000","last_fullsized":"2024-09-17T04:23:26.656443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656651+0000","last_change":"2024-09-17T04:23:25.367243+0000","last_active":"2024-09-17T04:23:26.656651+0000","last_peered":"2024-09-17T04:23:26.656651+0000","last_clean":"2024-09-17T04:23:26.656651+0000","last_became_active":"2024-09-17T04:23:25.366397+0000","last_became_peered":"2024-09-17T04:23:25.366397+0000","last_unstale":"2024-09-17T04:23:26.656651+0000","last_undegraded":"2024-09-17T04:23:26.656651+0000","last_fullsized":"2024-09-17T04:23:26.656651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468794+0000","last_change":"2024-09-17T04:23:24.352132+0000","last_active":"2024-09-17T04:23:26.468794+0000","last_peered":"2024-09-17T04:23:26.468794+0000","last_clean":"2024-09-17T04:23:26.468794+0000","last_became_active":"2024-09-17T04:23:24.351783+0000","last_became_peered":"2024-09-17T04:23:24.351783+0000","last_unstale":"2024-09-17T04:23:26.468794+0000","last_undegraded":"2024-09-17T04:23:26.468794+0000","last_fullsized":"2024-09-17T04:23:26.468794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657677+0000","last_change":"2024-09-17T04:23:25.357396+0000","last_active":"2024-09-17T04:23:26.657677+0000","last_peered":"2024-09-17T04:23:26.657677+0000","last_clean":"2024-09-17T04:23:26.657677+0000","last_became_active":"2024-09-17T04:23:25.357068+0000","last_became_peered":"2024-09-17T04:23:25.357068+0000","last_unstale":"2024-09-17T04:23:26.657677+0000","last_undegraded":"2024-09-17T04:23:26.657677+0000","last_fullsized":"2024-09-17T04:23:26.657677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360646+0000","last_change":"2024-09-17T04:23:25.373865+0000","last_active":"2024-09-17T04:23:26.360646+0000","last_peered":"2024-09-17T04:23:26.360646+0000","last_clean":"2024-09-17T04:23:26.360646+0000","last_became_active":"2024-09-17T04:23:25.373552+0000","last_became_peered":"2024-09-17T04:23:25.373552+0000","last_unstale":"2024-09-17T04:23:26.360646+0000","last_undegraded":"2024-09-17T04:23:26.360646+0000","last_fullsized":"2024-09-17T04:23:26.360646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.547724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468703+0000","last_change":"2024-09-17T04:23:24.356471+0000","last_active":"2024-09-17T04:23:26.468703+0000","last_peered":"2024-09-17T04:23:26.468703+0000","last_clean":"2024-09-17T04:23:26.468703+0000","last_became_active":"2024-09-17T04:23:24.356116+0000","last_became_peered":"2024-09-17T04:23:24.356116+0000","last_unstale":"2024-09-17T04:23:26.468703+0000","last_undegraded":"2024-09-17T04:23:26.468703+0000","last_fullsized":"2024-09-17T04:23:26.468703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659061+0000","last_change":"2024-09-17T04:23:25.375376+0000","last_active":"2024-09-17T04:23:26.659061+0000","last_peered":"2024-09-17T04:23:26.659061+0000","last_clean":"2024-09-17T04:23:26.659061+0000","last_became_active":"2024-09-17T04:23:25.375049+0000","last_became_peered":"2024-09-17T04:23:25.375049+0000","last_unstale":"2024-09-17T04:23:26.659061+0000","last_undegraded":"2024-09-17T04:23:26.659061+0000","last_fullsized":"2024-09-17T04:23:26.659061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:37.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657777+0000","last_change":"2024-09-17T04:23:24.343096+0000","last_active":"2024-09-17T04:23:26.657777+0000","last_peered":"2024-09-17T04:23:26.657777+0000","last_clean":"2024-09-17T04:23:26.657777+0000","last_became_active":"2024-09-17T04:23:24.340534+0000","last_became_peered":"2024-09-17T04:23:24.340534+0000","last_unstale":"2024-09-17T04:23:26.657777+0000","last_undegraded":"2024-09-17T04:23:26.657777+0000","last_fullsized":"2024-09-17T04:23:26.657777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656521+0000","last_change":"2024-09-17T04:23:25.372210+0000","last_active":"2024-09-17T04:23:26.656521+0000","last_peered":"2024-09-17T04:23:26.656521+0000","last_clean":"2024-09-17T04:23:26.656521+0000","last_became_active":"2024-09-17T04:23:25.371825+0000","last_became_peered":"2024-09-17T04:23:25.371825+0000","last_unstale":"2024-09-17T04:23:26.656521+0000","last_undegraded":"2024-09-17T04:23:26.656521+0000","last_fullsized":"2024-09-17T04:23:26.656521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:26.115764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659095+0000","last_change":"2024-09-17T04:23:25.381294+0000","last_active":"2024-09-17T04:23:26.659095+0000","last_peered":"2024-09-17T04:23:26.659095+0000","last_clean":"2024-09-17T04:23:26.659095+0000","last_became_active":"2024-09-17T04:23:25.379816+0000","last_became_peered":"2024-09-17T04:23:25.379816+0000","last_unstale":"2024-09-17T04:23:26.659095+0000","last_undegraded":"2024-09-17T04:23:26.659095+0000","last_fullsized":"2024-09-17T04:23:26.659095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:18.964734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468364+0000","last_change":"2024-09-17T04:23:24.352552+0000","last_active":"2024-09-17T04:23:26.468364+0000","last_peered":"2024-09-17T04:23:26.468364+0000","last_clean":"2024-09-17T04:23:26.468364+0000","last_became_active":"2024-09-17T04:23:24.352220+0000","last_became_peered":"2024-09-17T04:23:24.352220+0000","last_unstale":"2024-09-17T04:23:26.468364+0000","last_undegraded":"2024-09-17T04:23:26.468364+0000","last_fullsized":"2024-09-17T04:23:26.468364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468554+0000","last_change":"2024-09-17T04:23:25.367603+0000","last_active":"2024-09-17T04:23:26.468554+0000","last_peered":"2024-09-17T04:23:26.468554+0000","last_clean":"2024-09-17T04:23:26.468554+0000","last_became_active":"2024-09-17T04:23:25.367219+0000","last_became_peered":"2024-09-17T04:23:25.367219+0000","last_unstale":"2024-09-17T04:23:26.468554+0000","last_undegraded":"2024-09-17T04:23:26.468554+0000","last_fullsized":"2024-09-17T04:23:26.468554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:09.908355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656699+0000","last_change":"2024-09-17T04:23:24.354050+0000","last_active":"2024-09-17T04:23:26.656699+0000","last_peered":"2024-09-17T04:23:26.656699+0000","last_clean":"2024-09-17T04:23:26.656699+0000","last_became_active":"2024-09-17T04:23:24.353683+0000","last_became_peered":"2024-09-17T04:23:24.353683+0000","last_unstale":"2024-09-17T04:23:26.656699+0000","last_undegraded":"2024-09-17T04:23:26.656699+0000","last_fullsized":"2024-09-17T04:23:26.656699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:04.191476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658744+0000","last_change":"2024-09-17T04:23:25.376511+0000","last_active":"2024-09-17T04:23:26.658744+0000","last_peered":"2024-09-17T04:23:26.658744+0000","last_clean":"2024-09-17T04:23:26.658744+0000","last_became_active":"2024-09-17T04:23:25.376218+0000","last_became_peered":"2024-09-17T04:23:25.376218+0000","last_unstale":"2024-09-17T04:23:26.658744+0000","last_undegraded":"2024-09-17T04:23:26.658744+0000","last_fullsized":"2024-09-17T04:23:26.658744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:59.631965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360742+0000","last_change":"2024-09-17T04:23:24.339532+0000","last_active":"2024-09-17T04:23:26.360742+0000","last_peered":"2024-09-17T04:23:26.360742+0000","last_clean":"2024-09-17T04:23:26.360742+0000","last_became_active":"2024-09-17T04:23:24.338952+0000","last_became_peered":"2024-09-17T04:23:24.338952+0000","last_unstale":"2024-09-17T04:23:26.360742+0000","last_undegraded":"2024-09-17T04:23:26.360742+0000","last_fullsized":"2024-09-17T04:23:26.360742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:07.931802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659183+0000","last_change":"2024-09-17T04:23:25.378130+0000","last_active":"2024-09-17T04:23:26.659183+0000","last_peered":"2024-09-17T04:23:26.659183+0000","last_clean":"2024-09-17T04:23:26.659183+0000","last_became_active":"2024-09-17T04:23:25.377278+0000","last_became_peered":"2024-09-17T04:23:25.377278+0000","last_unstale":"2024-09-17T04:23:26.659183+0000","last_undegraded":"2024-09-17T04:23:26.659183+0000","last_fullsized":"2024-09-17T04:23:26.659183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.934488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656882+0000","last_change":"2024-09-17T04:23:24.354131+0000","last_active":"2024-09-17T04:23:26.656882+0000","last_peered":"2024-09-17T04:23:26.656882+0000","last_clean":"2024-09-17T04:23:26.656882+0000","last_became_active":"2024-09-17T04:23:24.353777+0000","last_became_peered":"2024-09-17T04:23:24.353777+0000","last_unstale":"2024-09-17T04:23:26.656882+0000","last_undegraded":"2024-09-17T04:23:26.656882+0000","last_fullsized":"2024-09-17T04:23:26.656882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659540+0000","last_change":"2024-09-17T04:23:25.379331+0000","last_active":"2024-09-17T04:23:26.659540+0000","last_peered":"2024-09-17T04:23:26.659540+0000","last_clean":"2024-09-17T04:23:26.659540+0000","last_became_active":"2024-09-17T04:23:25.377494+0000","last_became_peered":"2024-09-17T04:23:25.377494+0000","last_unstale":"2024-09-17T04:23:26.659540+0000","last_undegraded":"2024-09-17T04:23:26.659540+0000","last_fullsized":"2024-09-17T04:23:26.659540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:10.116857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656281+0000","last_change":"2024-09-17T04:23:24.349655+0000","last_active":"2024-09-17T04:23:26.656281+0000","last_peered":"2024-09-17T04:23:26.656281+0000","last_clean":"2024-09-17T04:23:26.656281+0000","last_became_active":"2024-09-17T04:23:24.349349+0000","last_became_peered":"2024-09-17T04:23:24.349349+0000","last_unstale":"2024-09-17T04:23:26.656281+0000","last_undegraded":"2024-09-17T04:23:26.656281+0000","last_fullsized":"2024-09-17T04:23:26.656281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:04.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659133+0000","last_change":"2024-09-17T04:23:25.380320+0000","last_active":"2024-09-17T04:23:26.659133+0000","last_peered":"2024-09-17T04:23:26.659133+0000","last_clean":"2024-09-17T04:23:26.659133+0000","last_became_active":"2024-09-17T04:23:25.379951+0000","last_became_peered":"2024-09-17T04:23:25.379951+0000","last_unstale":"2024-09-17T04:23:26.659133+0000","last_undegraded":"2024-09-17T04:23:26.659133+0000","last_fullsized":"2024-09-17T04:23:26.659133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:23.089918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658756+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:26.658756+0000","last_peered":"2024-09-17T04:23:26.658756+0000","last_clean":"2024-09-17T04:23:26.658756+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:26.658756+0000","last_undegraded":"2024-09-17T04:23:26.658756+0000","last_fullsized":"2024-09-17T04:23:26.658756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656250+0000","last_change":"2024-09-17T04:23:25.381586+0000","last_active":"2024-09-17T04:23:26.656250+0000","last_peered":"2024-09-17T04:23:26.656250+0000","last_clean":"2024-09-17T04:23:26.656250+0000","last_became_active":"2024-09-17T04:23:25.381261+0000","last_became_peered":"2024-09-17T04:23:25.381261+0000","last_unstale":"2024-09-17T04:23:26.656250+0000","last_undegraded":"2024-09-17T04:23:26.656250+0000","last_fullsized":"2024-09-17T04:23:26.656250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658502+0000","last_change":"2024-09-17T04:23:24.356897+0000","last_active":"2024-09-17T04:23:26.658502+0000","last_peered":"2024-09-17T04:23:26.658502+0000","last_clean":"2024-09-17T04:23:26.658502+0000","last_became_active":"2024-09-17T04:23:24.356553+0000","last_became_peered":"2024-09-17T04:23:24.356553+0000","last_unstale":"2024-09-17T04:23:26.658502+0000","last_undegraded":"2024-09-17T04:23:26.658502+0000","last_fullsized":"2024-09-17T04:23:26.658502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656883+0000","last_change":"2024-09-17T04:23:25.356801+0000","last_active":"2024-09-17T04:23:26.656883+0000","last_peered":"2024-09-17T04:23:26.656883+0000","last_clean":"2024-09-17T04:23:26.656883+0000","last_became_active":"2024-09-17T04:23:25.356450+0000","last_became_peered":"2024-09-17T04:23:25.356450+0000","last_unstale":"2024-09-17T04:23:26.656883+0000","last_undegraded":"2024-09-17T04:23:26.656883+0000","last_fullsized":"2024-09-17T04:23:26.656883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:30.495912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657024+0000","last_change":"2024-09-17T04:23:24.353192+0000","last_active":"2024-09-17T04:23:26.657024+0000","last_peered":"2024-09-17T04:23:26.657024+0000","last_clean":"2024-09-17T04:23:26.657024+0000","last_became_active":"2024-09-17T04:23:24.352863+0000","last_became_peered":"2024-09-17T04:23:24.352863+0000","last_unstale":"2024-09-17T04:23:26.657024+0000","last_undegraded":"2024-09-17T04:23:26.657024+0000","last_fullsized":"2024-09-17T04:23:26.657024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360605+0000","last_change":"2024-09-17T04:23:25.362549+0000","last_active":"2024-09-17T04:23:26.360605+0000","last_peered":"2024-09-17T04:23:26.360605+0000","last_clean":"2024-09-17T04:23:26.360605+0000","last_became_active":"2024-09-17T04:23:25.362227+0000","last_became_peered":"2024-09-17T04:23:25.362227+0000","last_unstale":"2024-09-17T04:23:26.360605+0000","last_undegraded":"2024-09-17T04:23:26.360605+0000","last_fullsized":"2024-09-17T04:23:26.360605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659359+0000","last_change":"2024-09-17T04:23:24.354097+0000","last_active":"2024-09-17T04:23:26.659359+0000","last_peered":"2024-09-17T04:23:26.659359+0000","last_clean":"2024-09-17T04:23:26.659359+0000","last_became_active":"2024-09-17T04:23:24.353583+0000","last_became_peered":"2024-09-17T04:23:24.353583+0000","last_unstale":"2024-09-17T04:23:26.659359+0000","last_undegraded":"2024-09-17T04:23:26.659359+0000","last_fullsized":"2024-09-17T04:23:26.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.874215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:27.053904+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:27.053904+0000","last_peered":"2024-09-17T04:23:27.053904+0000","last_clean":"2024-09-17T04:23:27.053904+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:27.053904+0000","last_undegraded":"2024-09-17T04:23:27.053904+0000","last_fullsized":"2024-09-17T04:23:27.053904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656641+0000","last_change":"2024-09-17T04:23:25.370909+0000","last_active":"2024-09-17T04:23:26.656641+0000","last_peered":"2024-09-17T04:23:26.656641+0000","last_clean":"2024-09-17T04:23:26.656641+0000","last_became_active":"2024-09-17T04:23:25.370575+0000","last_became_peered":"2024-09-17T04:23:25.370575+0000","last_unstale":"2024-09-17T04:23:26.656641+0000","last_undegraded":"2024-09-17T04:23:26.656641+0000","last_fullsized":"2024-09-17T04:23:26.656641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468856+0000","last_change":"2024-09-17T04:23:24.350404+0000","last_active":"2024-09-17T04:23:26.468856+0000","last_peered":"2024-09-17T04:23:26.468856+0000","last_clean":"2024-09-17T04:23:26.468856+0000","last_became_active":"2024-09-17T04:23:24.349057+0000","last_became_peered":"2024-09-17T04:23:24.349057+0000","last_unstale":"2024-09-17T04:23:26.468856+0000","last_undegraded":"2024-09-17T04:23:26.468856+0000","last_fullsized":"2024-09-17T04:23:26.468856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657233+0000","last_change":"2024-09-17T04:23:25.356958+0000","last_active":"2024-09-17T04:23:26.657233+0000","last_peered":"2024-09-17T04:23:26.657233+0000","last_clean":"2024-09-17T04:23:26.657233+0000","last_became_active":"2024-09-17T04:23:25.356609+0000","last_became_peered":"2024-09-17T04:23:25.356609+0000","last_unstale":"2024-09-17T04:23:26.657233+0000","last_undegraded":"2024-09-17T04:23:26.657233+0000","last_fullsized":"2024-09-17T04:23:26.657233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658663+0000","last_change":"2024-09-17T04:23:24.354084+0000","last_active":"2024-09-17T04:23:26.658663+0000","last_peered":"2024-09-17T04:23:26.658663+0000","last_clean":"2024-09-17T04:23:26.658663+0000","last_became_active":"2024-09-17T04:23:24.353744+0000","last_became_peered":"2024-09-17T04:23:24.353744+0000","last_unstale":"2024-09-17T04:23:26.658663+0000","last_undegraded":"2024-09-17T04:23:26.658663+0000","last_fullsized":"2024-09-17T04:23:26.658663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360379+0000","last_change":"2024-09-17T04:23:25.356709+0000","last_active":"2024-09-17T04:23:26.360379+0000","last_peered":"2024-09-17T04:23:26.360379+0000","last_clean":"2024-09-17T04:23:26.360379+0000","last_became_active":"2024-09-17T04:23:25.356403+0000","last_became_peered":"2024-09-17T04:23:25.356403+0000","last_unstale":"2024-09-17T04:23:26.360379+0000","last_undegraded":"2024-09-17T04:23:26.360379+0000","last_fullsized":"2024-09-17T04:23:26.360379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:49.386382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656896+0000","last_change":"2024-09-17T04:23:25.367584+0000","last_active":"2024-09-17T04:23:26.656896+0000","last_peered":"2024-09-17T04:23:26.656896+0000","last_clean":"2024-09-17T04:23:26.656896+0000","last_became_active":"2024-09-17T04:23:25.366943+0000","last_became_peered":"2024-09-17T04:23:25.366943+0000","last_unstale":"2024-09-17T04:23:26.656896+0000","last_undegraded":"2024-09-17T04:23:26.656896+0000","last_fullsized":"2024-09-17T04:23:26.656896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657231+0000","last_change":"2024-09-17T04:23:25.366947+0000","last_active":"2024-09-17T04:23:26.657231+0000","last_peered":"2024-09-17T04:23:26.657231+0000","last_clean":"2024-09-17T04:23:26.657231+0000","last_became_active":"2024-09-17T04:23:25.366593+0000","last_became_peered":"2024-09-17T04:23:25.366593+0000","last_unstale":"2024-09-17T04:23:26.657231+0000","last_undegraded":"2024-09-17T04:23:26.657231+0000","last_fullsized":"2024-09-17T04:23:26.657231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.638076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659143+0000","last_change":"2024-09-17T04:23:24.351819+0000","last_active":"2024-09-17T04:23:26.659143+0000","last_peered":"2024-09-17T04:23:26.659143+0000","last_clean":"2024-09-17T04:23:26.659143+0000","last_became_active":"2024-09-17T04:23:24.351483+0000","last_became_peered":"2024-09-17T04:23:24.351483+0000","last_unstale":"2024-09-17T04:23:26.659143+0000","last_undegraded":"2024-09-17T04:23:26.659143+0000","last_fullsized":"2024-09-17T04:23:26.659143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:18.736197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468638+0000","last_change":"2024-09-17T04:23:25.369382+0000","last_active":"2024-09-17T04:23:26.468638+0000","last_peered":"2024-09-17T04:23:26.468638+0000","last_clean":"2024-09-17T04:23:26.468638+0000","last_became_active":"2024-09-17T04:23:25.369026+0000","last_became_peered":"2024-09-17T04:23:25.369026+0000","last_unstale":"2024-09-17T04:23:26.468638+0000","last_undegraded":"2024-09-17T04:23:26.468638+0000","last_fullsized":"2024-09-17T04:23:26.468638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658625+0000","last_change":"2024-09-17T04:23:24.349161+0000","last_active":"2024-09-17T04:23:26.658625+0000","last_peered":"2024-09-17T04:23:26.658625+0000","last_clean":"2024-09-17T04:23:26.658625+0000","last_became_active":"2024-09-17T04:23:24.348825+0000","last_became_peered":"2024-09-17T04:23:24.348825+0000","last_unstale":"2024-09-17T04:23:26.658625+0000","last_undegraded":"2024-09-17T04:23:26.658625+0000","last_fullsized":"2024-09-17T04:23:26.658625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.666124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659219+0000","last_change":"2024-09-17T04:23:24.353160+0000","last_active":"2024-09-17T04:23:26.659219+0000","last_peered":"2024-09-17T04:23:26.659219+0000","last_clean":"2024-09-17T04:23:26.659219+0000","last_became_active":"2024-09-17T04:23:24.352829+0000","last_became_peered":"2024-09-17T04:23:24.352829+0000","last_unstale":"2024-09-17T04:23:26.659219+0000","last_undegraded":"2024-09-17T04:23:26.659219+0000","last_fullsized":"2024-09-17T04:23:26.659219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657688+0000","last_change":"2024-09-17T04:23:25.370271+0000","last_active":"2024-09-17T04:23:26.657688+0000","last_peered":"2024-09-17T04:23:26.657688+0000","last_clean":"2024-09-17T04:23:26.657688+0000","last_became_active":"2024-09-17T04:23:25.369591+0000","last_became_peered":"2024-09-17T04:23:25.369591+0000","last_unstale":"2024-09-17T04:23:26.657688+0000","last_undegraded":"2024-09-17T04:23:26.657688+0000","last_fullsized":"2024-09-17T04:23:26.657688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656558+0000","last_change":"2024-09-17T04:23:24.356821+0000","last_active":"2024-09-17T04:23:26.656558+0000","last_peered":"2024-09-17T04:23:26.656558+0000","last_clean":"2024-09-17T04:23:26.656558+0000","last_became_active":"2024-09-17T04:23:24.356475+0000","last_became_peered":"2024-09-17T04:23:24.356475+0000","last_unstale":"2024-09-17T04:23:26.656558+0000","last_undegraded":"2024-09-17T04:23:26.656558+0000","last_fullsized":"2024-09-17T04:23:26.656558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:42.496632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656387+0000","last_change":"2024-09-17T04:23:25.364361+0000","last_active":"2024-09-17T04:23:26.656387+0000","last_peered":"2024-09-17T04:23:26.656387+0000","last_clean":"2024-09-17T04:23:26.656387+0000","last_became_active":"2024-09-17T04:23:25.363990+0000","last_became_peered":"2024-09-17T04:23:25.363990+0000","last_unstale":"2024-09-17T04:23:26.656387+0000","last_undegraded":"2024-09-17T04:23:26.656387+0000","last_fullsized":"2024-09-17T04:23:26.656387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657778+0000","last_change":"2024-09-17T04:23:24.349646+0000","last_active":"2024-09-17T04:23:26.657778+0000","last_peered":"2024-09-17T04:23:26.657778+0000","last_clean":"2024-09-17T04:23:26.657778+0000","last_became_active":"2024-09-17T04:23:24.349309+0000","last_became_peered":"2024-09-17T04:23:24.349309+0000","last_unstale":"2024-09-17T04:23:26.657778+0000","last_undegraded":"2024-09-17T04:23:26.657778+0000","last_fullsized":"2024-09-17T04:23:26.657778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:33.135083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:37.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 -- 172.21.15.63:0/2048636327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80b66b0 msgr2=0x7f01c80d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 --2- 172.21.15.63:0/2048636327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80b66b0 0x7f01c80d4d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01c80d00e0 tx=0x7f01b802a580 comp rx=0 tx=0).stop 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 -- 172.21.15.63:0/2048636327 shutdown_connections 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 --2- 172.21.15.63:0/2048636327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80b66b0 0x7f01c80d4d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 -- 172.21.15.63:0/2048636327 >> 172.21.15.63:0/2048636327 conn(0x7f01c809d7f0 msgr2=0x7f01c80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 -- 172.21.15.63:0/2048636327 shutdown_connections 2024-09-17T04:23:37.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.322+0000 7f01cf43f640 1 -- 172.21.15.63:0/2048636327 wait complete. 2024-09-17T04:23:37.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.324+0000 7f01cf43f640 1 Processor -- start 2024-09-17T04:23:37.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.324+0000 7f01cf43f640 1 -- start start 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c80b9b60 0x7f01c80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c80b50d0 0x7f01c80cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01c806f830 con 0x7f01c80cf540 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01c806f6b0 con 0x7f01c80b9b60 2024-09-17T04:23:37.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cf43f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f01c806f9b0 con 0x7f01c80b50d0 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cc9da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cc9da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36346/0 (socket says 172.21.15.63:36346) 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cc9da640 1 -- 172.21.15.63:0/3412790926 learned_addr learned my addr 172.21.15.63:0/3412790926 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cd1db640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c80b9b60 0x7f01c80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.325+0000 7f01cd9dc640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c80b50d0 0x7f01c80cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 -- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c80b50d0 msgr2=0x7f01c80cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c80b50d0 0x7f01c80cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 -- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c80b9b60 msgr2=0x7f01c80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c80b9b60 0x7f01c80c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 -- 172.21.15.63:0/3412790926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c81f6660 con 0x7f01c80cf540 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cc9da640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01b8034040 tx=0x7f01b80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b803e030 con 0x7f01c80cf540 2024-09-17T04:23:37.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01b80047a0 con 0x7f01c80cf540 2024-09-17T04:23:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81f5a50 con 0x7f01c80cf540 2024-09-17T04:23:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8035040 con 0x7f01c80cf540 2024-09-17T04:23:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.326+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81f62f0 con 0x7f01c80cf540 2024-09-17T04:23:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.327+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c80d4d80 con 0x7f01c80cf540 2024-09-17T04:23:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.328+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01b8041030 con 0x7f01c80cf540 2024-09-17T04:23:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.328+0000 7f01bdffb640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 0x7f01ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.329+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f01b80bb5a0 con 0x7f01c80cf540 2024-09-17T04:23:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.329+0000 7f01cd1db640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 0x7f01ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.329+0000 7f01cd1db640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 0x7f01ac07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f01c4000fd0 tx=0x7f01c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.333+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01b8083390 con 0x7f01c80cf540 2024-09-17T04:23:37.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.514+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01c80d3fb0 con 0x7f01ac078bc0 2024-09-17T04:23:37.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.518+0000 7f01bdffb640 1 -- 172.21.15.63:0/3412790926 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f01c80d3fb0 con 0x7f01ac078bc0 2024-09-17T04:23:37.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:37.522 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 msgr2=0x7f01ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 0x7f01ac07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f01c4000fd0 tx=0x7f01c4009040 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 msgr2=0x7f01c80c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f01b8034040 tx=0x7f01b80039e0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 shutdown_connections 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f01ac078bc0 0x7f01ac07b0d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01c80b50d0 0x7f01c80cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01c80cf540 0x7f01c80c96c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 --2- 172.21.15.63:0/3412790926 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01c80b9b60 0x7f01c80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.521+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 >> 172.21.15.63:0/3412790926 conn(0x7f01c809d7f0 msgr2=0x7f01c80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.522+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 shutdown_connections 2024-09-17T04:23:37.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.522+0000 7f01cf43f640 1 -- 172.21.15.63:0/3412790926 wait complete. 2024-09-17T04:23:37.532 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T04:23:36.401086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.042669"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659274+0000","last_change":"2024-09-17T04:23:25.376557+0000","last_active":"2024-09-17T04:23:26.659274+0000","last_peered":"2024-09-17T04:23:26.659274+0000","last_clean":"2024-09-17T04:23:26.659274+0000","last_became_active":"2024-09-17T04:23:25.376196+0000","last_became_peered":"2024-09-17T04:23:25.376196+0000","last_unstale":"2024-09-17T04:23:26.659274+0000","last_undegraded":"2024-09-17T04:23:26.659274+0000","last_fullsized":"2024-09-17T04:23:26.659274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:31.126084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357033+0000","last_change":"2024-09-17T04:23:25.361841+0000","last_active":"2024-09-17T04:23:26.357033+0000","last_peered":"2024-09-17T04:23:26.357033+0000","last_clean":"2024-09-17T04:23:26.357033+0000","last_became_active":"2024-09-17T04:23:25.361195+0000","last_became_peered":"2024-09-17T04:23:25.361195+0000","last_unstale":"2024-09-17T04:23:26.357033+0000","last_undegraded":"2024-09-17T04:23:26.357033+0000","last_fullsized":"2024-09-17T04:23:26.357033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657398+0000","last_change":"2024-09-17T04:23:25.357621+0000","last_active":"2024-09-17T04:23:26.657398+0000","last_peered":"2024-09-17T04:23:26.657398+0000","last_clean":"2024-09-17T04:23:26.657398+0000","last_became_active":"2024-09-17T04:23:25.355965+0000","last_became_peered":"2024-09-17T04:23:25.355965+0000","last_unstale":"2024-09-17T04:23:26.657398+0000","last_undegraded":"2024-09-17T04:23:26.657398+0000","last_fullsized":"2024-09-17T04:23:26.657398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362017+0000","last_change":"2024-09-17T04:23:25.376625+0000","last_active":"2024-09-17T04:23:26.362017+0000","last_peered":"2024-09-17T04:23:26.362017+0000","last_clean":"2024-09-17T04:23:26.362017+0000","last_became_active":"2024-09-17T04:23:25.376309+0000","last_became_peered":"2024-09-17T04:23:25.376309+0000","last_unstale":"2024-09-17T04:23:26.362017+0000","last_undegraded":"2024-09-17T04:23:26.362017+0000","last_fullsized":"2024-09-17T04:23:26.362017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:15.643223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659057+0000","last_change":"2024-09-17T04:23:25.373604+0000","last_active":"2024-09-17T04:23:26.659057+0000","last_peered":"2024-09-17T04:23:26.659057+0000","last_clean":"2024-09-17T04:23:26.659057+0000","last_became_active":"2024-09-17T04:23:25.373309+0000","last_became_peered":"2024-09-17T04:23:25.373309+0000","last_unstale":"2024-09-17T04:23:26.659057+0000","last_undegraded":"2024-09-17T04:23:26.659057+0000","last_fullsized":"2024-09-17T04:23:26.659057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362196+0000","last_change":"2024-09-17T04:23:25.365245+0000","last_active":"2024-09-17T04:23:26.362196+0000","last_peered":"2024-09-17T04:23:26.362196+0000","last_clean":"2024-09-17T04:23:26.362196+0000","last_became_active":"2024-09-17T04:23:25.364773+0000","last_became_peered":"2024-09-17T04:23:25.364773+0000","last_unstale":"2024-09-17T04:23:26.362196+0000","last_undegraded":"2024-09-17T04:23:26.362196+0000","last_fullsized":"2024-09-17T04:23:26.362196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.607002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658926+0000","last_change":"2024-09-17T04:23:25.379332+0000","last_active":"2024-09-17T04:23:26.658926+0000","last_peered":"2024-09-17T04:23:26.658926+0000","last_clean":"2024-09-17T04:23:26.658926+0000","last_became_active":"2024-09-17T04:23:25.377519+0000","last_became_peered":"2024-09-17T04:23:25.377519+0000","last_unstale":"2024-09-17T04:23:26.658926+0000","last_undegraded":"2024-09-17T04:23:26.658926+0000","last_fullsized":"2024-09-17T04:23:26.658926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:14.203036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656178+0000","last_change":"2024-09-17T04:23:25.381475+0000","last_active":"2024-09-17T04:23:26.656178+0000","last_peered":"2024-09-17T04:23:26.656178+0000","last_clean":"2024-09-17T04:23:26.656178+0000","last_became_active":"2024-09-17T04:23:25.381163+0000","last_became_peered":"2024-09-17T04:23:25.381163+0000","last_unstale":"2024-09-17T04:23:26.656178+0000","last_undegraded":"2024-09-17T04:23:26.656178+0000","last_fullsized":"2024-09-17T04:23:26.656178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659283+0000","last_change":"2024-09-17T04:23:25.373332+0000","last_active":"2024-09-17T04:23:26.659283+0000","last_peered":"2024-09-17T04:23:26.659283+0000","last_clean":"2024-09-17T04:23:26.659283+0000","last_became_active":"2024-09-17T04:23:25.372980+0000","last_became_peered":"2024-09-17T04:23:25.372980+0000","last_unstale":"2024-09-17T04:23:26.659283+0000","last_undegraded":"2024-09-17T04:23:26.659283+0000","last_fullsized":"2024-09-17T04:23:26.659283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:56.403052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468977+0000","last_change":"2024-09-17T04:23:25.365489+0000","last_active":"2024-09-17T04:23:26.468977+0000","last_peered":"2024-09-17T04:23:26.468977+0000","last_clean":"2024-09-17T04:23:26.468977+0000","last_became_active":"2024-09-17T04:23:25.365166+0000","last_became_peered":"2024-09-17T04:23:25.365166+0000","last_unstale":"2024-09-17T04:23:26.468977+0000","last_undegraded":"2024-09-17T04:23:26.468977+0000","last_fullsized":"2024-09-17T04:23:26.468977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468815+0000","last_change":"2024-09-17T04:23:25.369673+0000","last_active":"2024-09-17T04:23:26.468815+0000","last_peered":"2024-09-17T04:23:26.468815+0000","last_clean":"2024-09-17T04:23:26.468815+0000","last_became_active":"2024-09-17T04:23:25.369360+0000","last_became_peered":"2024-09-17T04:23:25.369360+0000","last_unstale":"2024-09-17T04:23:26.468815+0000","last_undegraded":"2024-09-17T04:23:26.468815+0000","last_fullsized":"2024-09-17T04:23:26.468815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360528+0000","last_change":"2024-09-17T04:23:25.365165+0000","last_active":"2024-09-17T04:23:26.360528+0000","last_peered":"2024-09-17T04:23:26.360528+0000","last_clean":"2024-09-17T04:23:26.360528+0000","last_became_active":"2024-09-17T04:23:25.364840+0000","last_became_peered":"2024-09-17T04:23:25.364840+0000","last_unstale":"2024-09-17T04:23:26.360528+0000","last_undegraded":"2024-09-17T04:23:26.360528+0000","last_fullsized":"2024-09-17T04:23:26.360528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657001+0000","last_change":"2024-09-17T04:23:25.363017+0000","last_active":"2024-09-17T04:23:26.657001+0000","last_peered":"2024-09-17T04:23:26.657001+0000","last_clean":"2024-09-17T04:23:26.657001+0000","last_became_active":"2024-09-17T04:23:25.362696+0000","last_became_peered":"2024-09-17T04:23:25.362696+0000","last_unstale":"2024-09-17T04:23:26.657001+0000","last_undegraded":"2024-09-17T04:23:26.657001+0000","last_fullsized":"2024-09-17T04:23:26.657001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:29.184786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656448+0000","last_change":"2024-09-17T04:23:25.366854+0000","last_active":"2024-09-17T04:23:26.656448+0000","last_peered":"2024-09-17T04:23:26.656448+0000","last_clean":"2024-09-17T04:23:26.656448+0000","last_became_active":"2024-09-17T04:23:25.366508+0000","last_became_peered":"2024-09-17T04:23:25.366508+0000","last_unstale":"2024-09-17T04:23:26.656448+0000","last_undegraded":"2024-09-17T04:23:26.656448+0000","last_fullsized":"2024-09-17T04:23:26.656448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:55.579822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356678+0000","last_change":"2024-09-17T04:23:25.356206+0000","last_active":"2024-09-17T04:23:26.356678+0000","last_peered":"2024-09-17T04:23:26.356678+0000","last_clean":"2024-09-17T04:23:26.356678+0000","last_became_active":"2024-09-17T04:23:25.355560+0000","last_became_peered":"2024-09-17T04:23:25.355560+0000","last_unstale":"2024-09-17T04:23:26.356678+0000","last_undegraded":"2024-09-17T04:23:26.356678+0000","last_fullsized":"2024-09-17T04:23:26.356678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.379042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361156+0000","last_change":"2024-09-17T04:23:25.368098+0000","last_active":"2024-09-17T04:23:26.361156+0000","last_peered":"2024-09-17T04:23:26.361156+0000","last_clean":"2024-09-17T04:23:26.361156+0000","last_became_active":"2024-09-17T04:23:25.367748+0000","last_became_peered":"2024-09-17T04:23:25.367748+0000","last_unstale":"2024-09-17T04:23:26.361156+0000","last_undegraded":"2024-09-17T04:23:26.361156+0000","last_fullsized":"2024-09-17T04:23:26.361156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361807+0000","last_change":"2024-09-17T04:23:25.369995+0000","last_active":"2024-09-17T04:23:26.361807+0000","last_peered":"2024-09-17T04:23:26.361807+0000","last_clean":"2024-09-17T04:23:26.361807+0000","last_became_active":"2024-09-17T04:23:25.369550+0000","last_became_peered":"2024-09-17T04:23:25.369550+0000","last_unstale":"2024-09-17T04:23:26.361807+0000","last_undegraded":"2024-09-17T04:23:26.361807+0000","last_fullsized":"2024-09-17T04:23:26.361807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:29.174097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656798+0000","last_change":"2024-09-17T04:23:25.363990+0000","last_active":"2024-09-17T04:23:26.656798+0000","last_peered":"2024-09-17T04:23:26.656798+0000","last_clean":"2024-09-17T04:23:26.656798+0000","last_became_active":"2024-09-17T04:23:25.363609+0000","last_became_peered":"2024-09-17T04:23:25.363609+0000","last_unstale":"2024-09-17T04:23:26.656798+0000","last_undegraded":"2024-09-17T04:23:26.656798+0000","last_fullsized":"2024-09-17T04:23:26.656798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:49.162372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659347+0000","last_change":"2024-09-17T04:23:25.372922+0000","last_active":"2024-09-17T04:23:26.659347+0000","last_peered":"2024-09-17T04:23:26.659347+0000","last_clean":"2024-09-17T04:23:26.659347+0000","last_became_active":"2024-09-17T04:23:25.372597+0000","last_became_peered":"2024-09-17T04:23:25.372597+0000","last_unstale":"2024-09-17T04:23:26.659347+0000","last_undegraded":"2024-09-17T04:23:26.659347+0000","last_fullsized":"2024-09-17T04:23:26.659347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:46.131348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468848+0000","last_change":"2024-09-17T04:23:25.369858+0000","last_active":"2024-09-17T04:23:26.468848+0000","last_peered":"2024-09-17T04:23:26.468848+0000","last_clean":"2024-09-17T04:23:26.468848+0000","last_became_active":"2024-09-17T04:23:25.369523+0000","last_became_peered":"2024-09-17T04:23:25.369523+0000","last_unstale":"2024-09-17T04:23:26.468848+0000","last_undegraded":"2024-09-17T04:23:26.468848+0000","last_fullsized":"2024-09-17T04:23:26.468848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657526+0000","last_change":"2024-09-17T04:23:25.372496+0000","last_active":"2024-09-17T04:23:26.657526+0000","last_peered":"2024-09-17T04:23:26.657526+0000","last_clean":"2024-09-17T04:23:26.657526+0000","last_became_active":"2024-09-17T04:23:25.371988+0000","last_became_peered":"2024-09-17T04:23:25.371988+0000","last_unstale":"2024-09-17T04:23:26.657526+0000","last_undegraded":"2024-09-17T04:23:26.657526+0000","last_fullsized":"2024-09-17T04:23:26.657526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362147+0000","last_change":"2024-09-17T04:23:25.370185+0000","last_active":"2024-09-17T04:23:26.362147+0000","last_peered":"2024-09-17T04:23:26.362147+0000","last_clean":"2024-09-17T04:23:26.362147+0000","last_became_active":"2024-09-17T04:23:25.369820+0000","last_became_peered":"2024-09-17T04:23:25.369820+0000","last_unstale":"2024-09-17T04:23:26.362147+0000","last_undegraded":"2024-09-17T04:23:26.362147+0000","last_fullsized":"2024-09-17T04:23:26.362147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:44.014841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656520+0000","last_change":"2024-09-17T04:23:25.370154+0000","last_active":"2024-09-17T04:23:26.656520+0000","last_peered":"2024-09-17T04:23:26.656520+0000","last_clean":"2024-09-17T04:23:26.656520+0000","last_became_active":"2024-09-17T04:23:25.369846+0000","last_became_peered":"2024-09-17T04:23:25.369846+0000","last_unstale":"2024-09-17T04:23:26.656520+0000","last_undegraded":"2024-09-17T04:23:26.656520+0000","last_fullsized":"2024-09-17T04:23:26.656520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361273+0000","last_change":"2024-09-17T04:23:25.373995+0000","last_active":"2024-09-17T04:23:26.361273+0000","last_peered":"2024-09-17T04:23:26.361273+0000","last_clean":"2024-09-17T04:23:26.361273+0000","last_became_active":"2024-09-17T04:23:25.373544+0000","last_became_peered":"2024-09-17T04:23:25.373544+0000","last_unstale":"2024-09-17T04:23:26.361273+0000","last_undegraded":"2024-09-17T04:23:26.361273+0000","last_fullsized":"2024-09-17T04:23:26.361273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:39.708037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656790+0000","last_change":"2024-09-17T04:23:25.374875+0000","last_active":"2024-09-17T04:23:26.656790+0000","last_peered":"2024-09-17T04:23:26.656790+0000","last_clean":"2024-09-17T04:23:26.656790+0000","last_became_active":"2024-09-17T04:23:25.374565+0000","last_became_peered":"2024-09-17T04:23:25.374565+0000","last_unstale":"2024-09-17T04:23:26.656790+0000","last_undegraded":"2024-09-17T04:23:26.656790+0000","last_fullsized":"2024-09-17T04:23:26.656790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468983+0000","last_change":"2024-09-17T04:23:25.371408+0000","last_active":"2024-09-17T04:23:26.468983+0000","last_peered":"2024-09-17T04:23:26.468983+0000","last_clean":"2024-09-17T04:23:26.468983+0000","last_became_active":"2024-09-17T04:23:25.371085+0000","last_became_peered":"2024-09-17T04:23:25.371085+0000","last_unstale":"2024-09-17T04:23:26.468983+0000","last_undegraded":"2024-09-17T04:23:26.468983+0000","last_fullsized":"2024-09-17T04:23:26.468983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:17.992287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356912+0000","last_change":"2024-09-17T04:23:25.363079+0000","last_active":"2024-09-17T04:23:26.356912+0000","last_peered":"2024-09-17T04:23:26.356912+0000","last_clean":"2024-09-17T04:23:26.356912+0000","last_became_active":"2024-09-17T04:23:25.362778+0000","last_became_peered":"2024-09-17T04:23:25.362778+0000","last_unstale":"2024-09-17T04:23:26.356912+0000","last_undegraded":"2024-09-17T04:23:26.356912+0000","last_fullsized":"2024-09-17T04:23:26.356912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:12.854054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657086+0000","last_change":"2024-09-17T04:23:25.370366+0000","last_active":"2024-09-17T04:23:26.657086+0000","last_peered":"2024-09-17T04:23:26.657086+0000","last_clean":"2024-09-17T04:23:26.657086+0000","last_became_active":"2024-09-17T04:23:25.369986+0000","last_became_peered":"2024-09-17T04:23:25.369986+0000","last_unstale":"2024-09-17T04:23:26.657086+0000","last_undegraded":"2024-09-17T04:23:26.657086+0000","last_fullsized":"2024-09-17T04:23:26.657086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:20.547745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657687+0000","last_change":"2024-09-17T04:23:25.363653+0000","last_active":"2024-09-17T04:23:26.657687+0000","last_peered":"2024-09-17T04:23:26.657687+0000","last_clean":"2024-09-17T04:23:26.657687+0000","last_became_active":"2024-09-17T04:23:25.363060+0000","last_became_peered":"2024-09-17T04:23:25.363060+0000","last_unstale":"2024-09-17T04:23:26.657687+0000","last_undegraded":"2024-09-17T04:23:26.657687+0000","last_fullsized":"2024-09-17T04:23:26.657687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:23.405663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362294+0000","last_change":"2024-09-17T04:23:25.378294+0000","last_active":"2024-09-17T04:23:26.362294+0000","last_peered":"2024-09-17T04:23:26.362294+0000","last_clean":"2024-09-17T04:23:26.362294+0000","last_became_active":"2024-09-17T04:23:25.376367+0000","last_became_peered":"2024-09-17T04:23:25.376367+0000","last_unstale":"2024-09-17T04:23:26.362294+0000","last_undegraded":"2024-09-17T04:23:26.362294+0000","last_fullsized":"2024-09-17T04:23:26.362294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:03.736026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656912+0000","last_change":"2024-09-17T04:23:25.365226+0000","last_active":"2024-09-17T04:23:26.656912+0000","last_peered":"2024-09-17T04:23:26.656912+0000","last_clean":"2024-09-17T04:23:26.656912+0000","last_became_active":"2024-09-17T04:23:25.364858+0000","last_became_peered":"2024-09-17T04:23:25.364858+0000","last_unstale":"2024-09-17T04:23:26.656912+0000","last_undegraded":"2024-09-17T04:23:26.656912+0000","last_fullsized":"2024-09-17T04:23:26.656912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468547+0000","last_change":"2024-09-17T04:23:25.363571+0000","last_active":"2024-09-17T04:23:26.468547+0000","last_peered":"2024-09-17T04:23:26.468547+0000","last_clean":"2024-09-17T04:23:26.468547+0000","last_became_active":"2024-09-17T04:23:25.363235+0000","last_became_peered":"2024-09-17T04:23:25.363235+0000","last_unstale":"2024-09-17T04:23:26.468547+0000","last_undegraded":"2024-09-17T04:23:26.468547+0000","last_fullsized":"2024-09-17T04:23:26.468547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360260+0000","last_change":"2024-09-17T04:23:25.363674+0000","last_active":"2024-09-17T04:23:26.360260+0000","last_peered":"2024-09-17T04:23:26.360260+0000","last_clean":"2024-09-17T04:23:26.360260+0000","last_became_active":"2024-09-17T04:23:25.363334+0000","last_became_peered":"2024-09-17T04:23:25.363334+0000","last_unstale":"2024-09-17T04:23:26.360260+0000","last_undegraded":"2024-09-17T04:23:26.360260+0000","last_fullsized":"2024-09-17T04:23:26.360260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:18.913452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657300+0000","last_change":"2024-09-17T04:23:24.353312+0000","last_active":"2024-09-17T04:23:26.657300+0000","last_peered":"2024-09-17T04:23:26.657300+0000","last_clean":"2024-09-17T04:23:26.657300+0000","last_became_active":"2024-09-17T04:23:24.352973+0000","last_became_peered":"2024-09-17T04:23:24.352973+0000","last_unstale":"2024-09-17T04:23:26.657300+0000","last_undegraded":"2024-09-17T04:23:26.657300+0000","last_fullsized":"2024-09-17T04:23:26.657300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:00.251669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657690+0000","last_change":"2024-09-17T04:23:25.367192+0000","last_active":"2024-09-17T04:23:26.657690+0000","last_peered":"2024-09-17T04:23:26.657690+0000","last_clean":"2024-09-17T04:23:26.657690+0000","last_became_active":"2024-09-17T04:23:25.366787+0000","last_became_peered":"2024-09-17T04:23:25.366787+0000","last_unstale":"2024-09-17T04:23:26.657690+0000","last_undegraded":"2024-09-17T04:23:26.657690+0000","last_fullsized":"2024-09-17T04:23:26.657690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:49.367492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468424+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.468424+0000","last_peered":"2024-09-17T04:23:26.468424+0000","last_clean":"2024-09-17T04:23:26.468424+0000","last_became_active":"2024-09-17T04:23:24.353296+0000","last_became_peered":"2024-09-17T04:23:24.353296+0000","last_unstale":"2024-09-17T04:23:26.468424+0000","last_undegraded":"2024-09-17T04:23:26.468424+0000","last_fullsized":"2024-09-17T04:23:26.468424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656443+0000","last_change":"2024-09-17T04:23:24.354209+0000","last_active":"2024-09-17T04:23:26.656443+0000","last_peered":"2024-09-17T04:23:26.656443+0000","last_clean":"2024-09-17T04:23:26.656443+0000","last_became_active":"2024-09-17T04:23:24.353857+0000","last_became_peered":"2024-09-17T04:23:24.353857+0000","last_unstale":"2024-09-17T04:23:26.656443+0000","last_undegraded":"2024-09-17T04:23:26.656443+0000","last_fullsized":"2024-09-17T04:23:26.656443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:03.862446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656651+0000","last_change":"2024-09-17T04:23:25.367243+0000","last_active":"2024-09-17T04:23:26.656651+0000","last_peered":"2024-09-17T04:23:26.656651+0000","last_clean":"2024-09-17T04:23:26.656651+0000","last_became_active":"2024-09-17T04:23:25.366397+0000","last_became_peered":"2024-09-17T04:23:25.366397+0000","last_unstale":"2024-09-17T04:23:26.656651+0000","last_undegraded":"2024-09-17T04:23:26.656651+0000","last_fullsized":"2024-09-17T04:23:26.656651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:34.572390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361294+0000","last_change":"2024-09-17T04:23:24.343504+0000","last_active":"2024-09-17T04:23:26.361294+0000","last_peered":"2024-09-17T04:23:26.361294+0000","last_clean":"2024-09-17T04:23:26.361294+0000","last_became_active":"2024-09-17T04:23:24.341456+0000","last_became_peered":"2024-09-17T04:23:24.341456+0000","last_unstale":"2024-09-17T04:23:26.361294+0000","last_undegraded":"2024-09-17T04:23:26.361294+0000","last_fullsized":"2024-09-17T04:23:26.361294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356758+0000","last_change":"2024-09-17T04:23:25.361409+0000","last_active":"2024-09-17T04:23:26.356758+0000","last_peered":"2024-09-17T04:23:26.356758+0000","last_clean":"2024-09-17T04:23:26.356758+0000","last_became_active":"2024-09-17T04:23:25.361088+0000","last_became_peered":"2024-09-17T04:23:25.361088+0000","last_unstale":"2024-09-17T04:23:26.356758+0000","last_undegraded":"2024-09-17T04:23:26.356758+0000","last_fullsized":"2024-09-17T04:23:26.356758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:38.466781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468794+0000","last_change":"2024-09-17T04:23:24.352132+0000","last_active":"2024-09-17T04:23:26.468794+0000","last_peered":"2024-09-17T04:23:26.468794+0000","last_clean":"2024-09-17T04:23:26.468794+0000","last_became_active":"2024-09-17T04:23:24.351783+0000","last_became_peered":"2024-09-17T04:23:24.351783+0000","last_unstale":"2024-09-17T04:23:26.468794+0000","last_undegraded":"2024-09-17T04:23:26.468794+0000","last_fullsized":"2024-09-17T04:23:26.468794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361546+0000","last_change":"2024-09-17T04:23:25.371041+0000","last_active":"2024-09-17T04:23:26.361546+0000","last_peered":"2024-09-17T04:23:26.361546+0000","last_clean":"2024-09-17T04:23:26.361546+0000","last_became_active":"2024-09-17T04:23:25.370714+0000","last_became_peered":"2024-09-17T04:23:25.370714+0000","last_unstale":"2024-09-17T04:23:26.361546+0000","last_undegraded":"2024-09-17T04:23:26.361546+0000","last_fullsized":"2024-09-17T04:23:26.361546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:28.169312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361830+0000","last_change":"2024-09-17T04:23:24.353636+0000","last_active":"2024-09-17T04:23:26.361830+0000","last_peered":"2024-09-17T04:23:26.361830+0000","last_clean":"2024-09-17T04:23:26.361830+0000","last_became_active":"2024-09-17T04:23:24.353347+0000","last_became_peered":"2024-09-17T04:23:24.353347+0000","last_unstale":"2024-09-17T04:23:26.361830+0000","last_undegraded":"2024-09-17T04:23:26.361830+0000","last_fullsized":"2024-09-17T04:23:26.361830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657677+0000","last_change":"2024-09-17T04:23:25.357396+0000","last_active":"2024-09-17T04:23:26.657677+0000","last_peered":"2024-09-17T04:23:26.657677+0000","last_clean":"2024-09-17T04:23:26.657677+0000","last_became_active":"2024-09-17T04:23:25.357068+0000","last_became_peered":"2024-09-17T04:23:25.357068+0000","last_unstale":"2024-09-17T04:23:26.657677+0000","last_undegraded":"2024-09-17T04:23:26.657677+0000","last_fullsized":"2024-09-17T04:23:26.657677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:56.520982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356986+0000","last_change":"2024-09-17T04:23:24.349857+0000","last_active":"2024-09-17T04:23:26.356986+0000","last_peered":"2024-09-17T04:23:26.356986+0000","last_clean":"2024-09-17T04:23:26.356986+0000","last_became_active":"2024-09-17T04:23:24.349515+0000","last_became_peered":"2024-09-17T04:23:24.349515+0000","last_unstale":"2024-09-17T04:23:26.356986+0000","last_undegraded":"2024-09-17T04:23:26.356986+0000","last_fullsized":"2024-09-17T04:23:26.356986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:24.339276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360646+0000","last_change":"2024-09-17T04:23:25.373865+0000","last_active":"2024-09-17T04:23:26.360646+0000","last_peered":"2024-09-17T04:23:26.360646+0000","last_clean":"2024-09-17T04:23:26.360646+0000","last_became_active":"2024-09-17T04:23:25.373552+0000","last_became_peered":"2024-09-17T04:23:25.373552+0000","last_unstale":"2024-09-17T04:23:26.360646+0000","last_undegraded":"2024-09-17T04:23:26.360646+0000","last_fullsized":"2024-09-17T04:23:26.360646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:54.547724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468703+0000","last_change":"2024-09-17T04:23:24.356471+0000","last_active":"2024-09-17T04:23:26.468703+0000","last_peered":"2024-09-17T04:23:26.468703+0000","last_clean":"2024-09-17T04:23:26.468703+0000","last_became_active":"2024-09-17T04:23:24.356116+0000","last_became_peered":"2024-09-17T04:23:24.356116+0000","last_unstale":"2024-09-17T04:23:26.468703+0000","last_undegraded":"2024-09-17T04:23:26.468703+0000","last_fullsized":"2024-09-17T04:23:26.468703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659061+0000","last_change":"2024-09-17T04:23:25.375376+0000","last_active":"2024-09-17T04:23:26.659061+0000","last_peered":"2024-09-17T04:23:26.659061+0000","last_clean":"2024-09-17T04:23:26.659061+0000","last_became_active":"2024-09-17T04:23:25.375049+0000","last_became_peered":"2024-09-17T04:23:25.375049+0000","last_unstale":"2024-09-17T04:23:26.659061+0000","last_undegraded":"2024-09-17T04:23:26.659061+0000","last_fullsized":"2024-09-17T04:23:26.659061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:37.223274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657777+0000","last_change":"2024-09-17T04:23:24.343096+0000","last_active":"2024-09-17T04:23:26.657777+0000","last_peered":"2024-09-17T04:23:26.657777+0000","last_clean":"2024-09-17T04:23:26.657777+0000","last_became_active":"2024-09-17T04:23:24.340534+0000","last_became_peered":"2024-09-17T04:23:24.340534+0000","last_unstale":"2024-09-17T04:23:26.657777+0000","last_undegraded":"2024-09-17T04:23:26.657777+0000","last_fullsized":"2024-09-17T04:23:26.657777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656521+0000","last_change":"2024-09-17T04:23:25.372210+0000","last_active":"2024-09-17T04:23:26.656521+0000","last_peered":"2024-09-17T04:23:26.656521+0000","last_clean":"2024-09-17T04:23:26.656521+0000","last_became_active":"2024-09-17T04:23:25.371825+0000","last_became_peered":"2024-09-17T04:23:25.371825+0000","last_unstale":"2024-09-17T04:23:26.656521+0000","last_undegraded":"2024-09-17T04:23:26.656521+0000","last_fullsized":"2024-09-17T04:23:26.656521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:26.115764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362328+0000","last_change":"2024-09-17T04:23:24.355854+0000","last_active":"2024-09-17T04:23:26.362328+0000","last_peered":"2024-09-17T04:23:26.362328+0000","last_clean":"2024-09-17T04:23:26.362328+0000","last_became_active":"2024-09-17T04:23:24.355530+0000","last_became_peered":"2024-09-17T04:23:24.355530+0000","last_unstale":"2024-09-17T04:23:26.362328+0000","last_undegraded":"2024-09-17T04:23:26.362328+0000","last_fullsized":"2024-09-17T04:23:26.362328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659095+0000","last_change":"2024-09-17T04:23:25.381294+0000","last_active":"2024-09-17T04:23:26.659095+0000","last_peered":"2024-09-17T04:23:26.659095+0000","last_clean":"2024-09-17T04:23:26.659095+0000","last_became_active":"2024-09-17T04:23:25.379816+0000","last_became_peered":"2024-09-17T04:23:25.379816+0000","last_unstale":"2024-09-17T04:23:26.659095+0000","last_undegraded":"2024-09-17T04:23:26.659095+0000","last_fullsized":"2024-09-17T04:23:26.659095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:18.964734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468364+0000","last_change":"2024-09-17T04:23:24.352552+0000","last_active":"2024-09-17T04:23:26.468364+0000","last_peered":"2024-09-17T04:23:26.468364+0000","last_clean":"2024-09-17T04:23:26.468364+0000","last_became_active":"2024-09-17T04:23:24.352220+0000","last_became_peered":"2024-09-17T04:23:24.352220+0000","last_unstale":"2024-09-17T04:23:26.468364+0000","last_undegraded":"2024-09-17T04:23:26.468364+0000","last_fullsized":"2024-09-17T04:23:26.468364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468554+0000","last_change":"2024-09-17T04:23:25.367603+0000","last_active":"2024-09-17T04:23:26.468554+0000","last_peered":"2024-09-17T04:23:26.468554+0000","last_clean":"2024-09-17T04:23:26.468554+0000","last_became_active":"2024-09-17T04:23:25.367219+0000","last_became_peered":"2024-09-17T04:23:25.367219+0000","last_unstale":"2024-09-17T04:23:26.468554+0000","last_undegraded":"2024-09-17T04:23:26.468554+0000","last_fullsized":"2024-09-17T04:23:26.468554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:09.908355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656699+0000","last_change":"2024-09-17T04:23:24.354050+0000","last_active":"2024-09-17T04:23:26.656699+0000","last_peered":"2024-09-17T04:23:26.656699+0000","last_clean":"2024-09-17T04:23:26.656699+0000","last_became_active":"2024-09-17T04:23:24.353683+0000","last_became_peered":"2024-09-17T04:23:24.353683+0000","last_unstale":"2024-09-17T04:23:26.656699+0000","last_undegraded":"2024-09-17T04:23:26.656699+0000","last_fullsized":"2024-09-17T04:23:26.656699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:04.191476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658744+0000","last_change":"2024-09-17T04:23:25.376511+0000","last_active":"2024-09-17T04:23:26.658744+0000","last_peered":"2024-09-17T04:23:26.658744+0000","last_clean":"2024-09-17T04:23:26.658744+0000","last_became_active":"2024-09-17T04:23:25.376218+0000","last_became_peered":"2024-09-17T04:23:25.376218+0000","last_unstale":"2024-09-17T04:23:26.658744+0000","last_undegraded":"2024-09-17T04:23:26.658744+0000","last_fullsized":"2024-09-17T04:23:26.658744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:59.631965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360742+0000","last_change":"2024-09-17T04:23:24.339532+0000","last_active":"2024-09-17T04:23:26.360742+0000","last_peered":"2024-09-17T04:23:26.360742+0000","last_clean":"2024-09-17T04:23:26.360742+0000","last_became_active":"2024-09-17T04:23:24.338952+0000","last_became_peered":"2024-09-17T04:23:24.338952+0000","last_unstale":"2024-09-17T04:23:26.360742+0000","last_undegraded":"2024-09-17T04:23:26.360742+0000","last_fullsized":"2024-09-17T04:23:26.360742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:07.931802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659183+0000","last_change":"2024-09-17T04:23:25.378130+0000","last_active":"2024-09-17T04:23:26.659183+0000","last_peered":"2024-09-17T04:23:26.659183+0000","last_clean":"2024-09-17T04:23:26.659183+0000","last_became_active":"2024-09-17T04:23:25.377278+0000","last_became_peered":"2024-09-17T04:23:25.377278+0000","last_unstale":"2024-09-17T04:23:26.659183+0000","last_undegraded":"2024-09-17T04:23:26.659183+0000","last_fullsized":"2024-09-17T04:23:26.659183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.934488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656882+0000","last_change":"2024-09-17T04:23:24.354131+0000","last_active":"2024-09-17T04:23:26.656882+0000","last_peered":"2024-09-17T04:23:26.656882+0000","last_clean":"2024-09-17T04:23:26.656882+0000","last_became_active":"2024-09-17T04:23:24.353777+0000","last_became_peered":"2024-09-17T04:23:24.353777+0000","last_unstale":"2024-09-17T04:23:26.656882+0000","last_undegraded":"2024-09-17T04:23:26.656882+0000","last_fullsized":"2024-09-17T04:23:26.656882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:35.910593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659540+0000","last_change":"2024-09-17T04:23:25.379331+0000","last_active":"2024-09-17T04:23:26.659540+0000","last_peered":"2024-09-17T04:23:26.659540+0000","last_clean":"2024-09-17T04:23:26.659540+0000","last_became_active":"2024-09-17T04:23:25.377494+0000","last_became_peered":"2024-09-17T04:23:25.377494+0000","last_unstale":"2024-09-17T04:23:26.659540+0000","last_undegraded":"2024-09-17T04:23:26.659540+0000","last_fullsized":"2024-09-17T04:23:26.659540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:10.116857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.357037+0000","last_change":"2024-09-17T04:23:24.347591+0000","last_active":"2024-09-17T04:23:26.357037+0000","last_peered":"2024-09-17T04:23:26.357037+0000","last_clean":"2024-09-17T04:23:26.357037+0000","last_became_active":"2024-09-17T04:23:24.347268+0000","last_became_peered":"2024-09-17T04:23:24.347268+0000","last_unstale":"2024-09-17T04:23:26.357037+0000","last_undegraded":"2024-09-17T04:23:26.357037+0000","last_fullsized":"2024-09-17T04:23:26.357037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:47.701508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362216+0000","last_change":"2024-09-17T04:23:25.373208+0000","last_active":"2024-09-17T04:23:26.362216+0000","last_peered":"2024-09-17T04:23:26.362216+0000","last_clean":"2024-09-17T04:23:26.362216+0000","last_became_active":"2024-09-17T04:23:25.372798+0000","last_became_peered":"2024-09-17T04:23:25.372798+0000","last_unstale":"2024-09-17T04:23:26.362216+0000","last_undegraded":"2024-09-17T04:23:26.362216+0000","last_fullsized":"2024-09-17T04:23:26.362216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:07.521005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656281+0000","last_change":"2024-09-17T04:23:24.349655+0000","last_active":"2024-09-17T04:23:26.656281+0000","last_peered":"2024-09-17T04:23:26.656281+0000","last_clean":"2024-09-17T04:23:26.656281+0000","last_became_active":"2024-09-17T04:23:24.349349+0000","last_became_peered":"2024-09-17T04:23:24.349349+0000","last_unstale":"2024-09-17T04:23:26.656281+0000","last_undegraded":"2024-09-17T04:23:26.656281+0000","last_fullsized":"2024-09-17T04:23:26.656281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:04.236511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659133+0000","last_change":"2024-09-17T04:23:25.380320+0000","last_active":"2024-09-17T04:23:26.659133+0000","last_peered":"2024-09-17T04:23:26.659133+0000","last_clean":"2024-09-17T04:23:26.659133+0000","last_became_active":"2024-09-17T04:23:25.379951+0000","last_became_peered":"2024-09-17T04:23:25.379951+0000","last_unstale":"2024-09-17T04:23:26.659133+0000","last_undegraded":"2024-09-17T04:23:26.659133+0000","last_fullsized":"2024-09-17T04:23:26.659133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:23.089918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658756+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:23:26.658756+0000","last_peered":"2024-09-17T04:23:26.658756+0000","last_clean":"2024-09-17T04:23:26.658756+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:23:26.658756+0000","last_undegraded":"2024-09-17T04:23:26.658756+0000","last_fullsized":"2024-09-17T04:23:26.658756+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361126+0000","last_change":"2024-09-17T04:23:24.347339+0000","last_active":"2024-09-17T04:23:26.361126+0000","last_peered":"2024-09-17T04:23:26.361126+0000","last_clean":"2024-09-17T04:23:26.361126+0000","last_became_active":"2024-09-17T04:23:24.346483+0000","last_became_peered":"2024-09-17T04:23:24.346483+0000","last_unstale":"2024-09-17T04:23:26.361126+0000","last_undegraded":"2024-09-17T04:23:26.361126+0000","last_fullsized":"2024-09-17T04:23:26.361126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:40.335444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656250+0000","last_change":"2024-09-17T04:23:25.381586+0000","last_active":"2024-09-17T04:23:26.656250+0000","last_peered":"2024-09-17T04:23:26.656250+0000","last_clean":"2024-09-17T04:23:26.656250+0000","last_became_active":"2024-09-17T04:23:25.381261+0000","last_became_peered":"2024-09-17T04:23:25.381261+0000","last_unstale":"2024-09-17T04:23:26.656250+0000","last_undegraded":"2024-09-17T04:23:26.656250+0000","last_fullsized":"2024-09-17T04:23:26.656250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:51.641248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658502+0000","last_change":"2024-09-17T04:23:24.356897+0000","last_active":"2024-09-17T04:23:26.658502+0000","last_peered":"2024-09-17T04:23:26.658502+0000","last_clean":"2024-09-17T04:23:26.658502+0000","last_became_active":"2024-09-17T04:23:24.356553+0000","last_became_peered":"2024-09-17T04:23:24.356553+0000","last_unstale":"2024-09-17T04:23:26.658502+0000","last_undegraded":"2024-09-17T04:23:26.658502+0000","last_fullsized":"2024-09-17T04:23:26.658502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:16.492850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656883+0000","last_change":"2024-09-17T04:23:25.356801+0000","last_active":"2024-09-17T04:23:26.656883+0000","last_peered":"2024-09-17T04:23:26.656883+0000","last_clean":"2024-09-17T04:23:26.656883+0000","last_became_active":"2024-09-17T04:23:25.356450+0000","last_became_peered":"2024-09-17T04:23:25.356450+0000","last_unstale":"2024-09-17T04:23:26.656883+0000","last_undegraded":"2024-09-17T04:23:26.656883+0000","last_fullsized":"2024-09-17T04:23:26.656883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:30.495912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657024+0000","last_change":"2024-09-17T04:23:24.353192+0000","last_active":"2024-09-17T04:23:26.657024+0000","last_peered":"2024-09-17T04:23:26.657024+0000","last_clean":"2024-09-17T04:23:26.657024+0000","last_became_active":"2024-09-17T04:23:24.352863+0000","last_became_peered":"2024-09-17T04:23:24.352863+0000","last_unstale":"2024-09-17T04:23:26.657024+0000","last_undegraded":"2024-09-17T04:23:26.657024+0000","last_fullsized":"2024-09-17T04:23:26.657024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:59.969234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356662+0000","last_change":"2024-09-17T04:23:25.357240+0000","last_active":"2024-09-17T04:23:26.356662+0000","last_peered":"2024-09-17T04:23:26.356662+0000","last_clean":"2024-09-17T04:23:26.356662+0000","last_became_active":"2024-09-17T04:23:25.356954+0000","last_became_peered":"2024-09-17T04:23:25.356954+0000","last_unstale":"2024-09-17T04:23:26.356662+0000","last_undegraded":"2024-09-17T04:23:26.356662+0000","last_fullsized":"2024-09-17T04:23:26.356662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:27.105040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362368+0000","last_change":"2024-09-17T04:23:24.346793+0000","last_active":"2024-09-17T04:23:26.362368+0000","last_peered":"2024-09-17T04:23:26.362368+0000","last_clean":"2024-09-17T04:23:26.362368+0000","last_became_active":"2024-09-17T04:23:24.346512+0000","last_became_peered":"2024-09-17T04:23:24.346512+0000","last_unstale":"2024-09-17T04:23:26.362368+0000","last_undegraded":"2024-09-17T04:23:26.362368+0000","last_fullsized":"2024-09-17T04:23:26.362368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:45.755137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360605+0000","last_change":"2024-09-17T04:23:25.362549+0000","last_active":"2024-09-17T04:23:26.360605+0000","last_peered":"2024-09-17T04:23:26.360605+0000","last_clean":"2024-09-17T04:23:26.360605+0000","last_became_active":"2024-09-17T04:23:25.362227+0000","last_became_peered":"2024-09-17T04:23:25.362227+0000","last_unstale":"2024-09-17T04:23:26.360605+0000","last_undegraded":"2024-09-17T04:23:26.360605+0000","last_fullsized":"2024-09-17T04:23:26.360605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:00.238590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356913+0000","last_change":"2024-09-17T04:23:24.352150+0000","last_active":"2024-09-17T04:23:26.356913+0000","last_peered":"2024-09-17T04:23:26.356913+0000","last_clean":"2024-09-17T04:23:26.356913+0000","last_became_active":"2024-09-17T04:23:24.351801+0000","last_became_peered":"2024-09-17T04:23:24.351801+0000","last_unstale":"2024-09-17T04:23:26.356913+0000","last_undegraded":"2024-09-17T04:23:26.356913+0000","last_fullsized":"2024-09-17T04:23:26.356913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.016147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361821+0000","last_change":"2024-09-17T04:23:25.372587+0000","last_active":"2024-09-17T04:23:26.361821+0000","last_peered":"2024-09-17T04:23:26.361821+0000","last_clean":"2024-09-17T04:23:26.361821+0000","last_became_active":"2024-09-17T04:23:25.372285+0000","last_became_peered":"2024-09-17T04:23:25.372285+0000","last_unstale":"2024-09-17T04:23:26.361821+0000","last_undegraded":"2024-09-17T04:23:26.361821+0000","last_fullsized":"2024-09-17T04:23:26.361821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:04.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659359+0000","last_change":"2024-09-17T04:23:24.354097+0000","last_active":"2024-09-17T04:23:26.659359+0000","last_peered":"2024-09-17T04:23:26.659359+0000","last_clean":"2024-09-17T04:23:26.659359+0000","last_became_active":"2024-09-17T04:23:24.353583+0000","last_became_peered":"2024-09-17T04:23:24.353583+0000","last_unstale":"2024-09-17T04:23:26.659359+0000","last_undegraded":"2024-09-17T04:23:26.659359+0000","last_fullsized":"2024-09-17T04:23:26.659359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.874215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356796+0000","last_change":"2024-09-17T04:23:25.358486+0000","last_active":"2024-09-17T04:23:26.356796+0000","last_peered":"2024-09-17T04:23:26.356796+0000","last_clean":"2024-09-17T04:23:26.356796+0000","last_became_active":"2024-09-17T04:23:25.358210+0000","last_became_peered":"2024-09-17T04:23:25.358210+0000","last_unstale":"2024-09-17T04:23:26.356796+0000","last_undegraded":"2024-09-17T04:23:26.356796+0000","last_fullsized":"2024-09-17T04:23:26.356796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:31.243096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:27.053904+0000","last_change":"2024-09-17T04:23:24.352849+0000","last_active":"2024-09-17T04:23:27.053904+0000","last_peered":"2024-09-17T04:23:27.053904+0000","last_clean":"2024-09-17T04:23:27.053904+0000","last_became_active":"2024-09-17T04:23:24.352400+0000","last_became_peered":"2024-09-17T04:23:24.352400+0000","last_unstale":"2024-09-17T04:23:27.053904+0000","last_undegraded":"2024-09-17T04:23:27.053904+0000","last_fullsized":"2024-09-17T04:23:27.053904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:01.682241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656641+0000","last_change":"2024-09-17T04:23:25.370909+0000","last_active":"2024-09-17T04:23:26.656641+0000","last_peered":"2024-09-17T04:23:26.656641+0000","last_clean":"2024-09-17T04:23:26.656641+0000","last_became_active":"2024-09-17T04:23:25.370575+0000","last_became_peered":"2024-09-17T04:23:25.370575+0000","last_unstale":"2024-09-17T04:23:26.656641+0000","last_undegraded":"2024-09-17T04:23:26.656641+0000","last_fullsized":"2024-09-17T04:23:26.656641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468856+0000","last_change":"2024-09-17T04:23:24.350404+0000","last_active":"2024-09-17T04:23:26.468856+0000","last_peered":"2024-09-17T04:23:26.468856+0000","last_clean":"2024-09-17T04:23:26.468856+0000","last_became_active":"2024-09-17T04:23:24.349057+0000","last_became_peered":"2024-09-17T04:23:24.349057+0000","last_unstale":"2024-09-17T04:23:26.468856+0000","last_undegraded":"2024-09-17T04:23:26.468856+0000","last_fullsized":"2024-09-17T04:23:26.468856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657233+0000","last_change":"2024-09-17T04:23:25.356958+0000","last_active":"2024-09-17T04:23:26.657233+0000","last_peered":"2024-09-17T04:23:26.657233+0000","last_clean":"2024-09-17T04:23:26.657233+0000","last_became_active":"2024-09-17T04:23:25.356609+0000","last_became_peered":"2024-09-17T04:23:25.356609+0000","last_unstale":"2024-09-17T04:23:26.657233+0000","last_undegraded":"2024-09-17T04:23:26.657233+0000","last_fullsized":"2024-09-17T04:23:26.657233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:39.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658663+0000","last_change":"2024-09-17T04:23:24.354084+0000","last_active":"2024-09-17T04:23:26.658663+0000","last_peered":"2024-09-17T04:23:26.658663+0000","last_clean":"2024-09-17T04:23:26.658663+0000","last_became_active":"2024-09-17T04:23:24.353744+0000","last_became_peered":"2024-09-17T04:23:24.353744+0000","last_unstale":"2024-09-17T04:23:26.658663+0000","last_undegraded":"2024-09-17T04:23:26.658663+0000","last_fullsized":"2024-09-17T04:23:26.658663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:30.185093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.360379+0000","last_change":"2024-09-17T04:23:25.356709+0000","last_active":"2024-09-17T04:23:26.360379+0000","last_peered":"2024-09-17T04:23:26.360379+0000","last_clean":"2024-09-17T04:23:26.360379+0000","last_became_active":"2024-09-17T04:23:25.356403+0000","last_became_peered":"2024-09-17T04:23:25.356403+0000","last_unstale":"2024-09-17T04:23:26.360379+0000","last_undegraded":"2024-09-17T04:23:26.360379+0000","last_fullsized":"2024-09-17T04:23:26.360379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:49.386382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356793+0000","last_change":"2024-09-17T04:23:24.348989+0000","last_active":"2024-09-17T04:23:26.356793+0000","last_peered":"2024-09-17T04:23:26.356793+0000","last_clean":"2024-09-17T04:23:26.356793+0000","last_became_active":"2024-09-17T04:23:24.348603+0000","last_became_peered":"2024-09-17T04:23:24.348603+0000","last_unstale":"2024-09-17T04:23:26.356793+0000","last_undegraded":"2024-09-17T04:23:26.356793+0000","last_fullsized":"2024-09-17T04:23:26.356793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:06.390538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656896+0000","last_change":"2024-09-17T04:23:25.367584+0000","last_active":"2024-09-17T04:23:26.656896+0000","last_peered":"2024-09-17T04:23:26.656896+0000","last_clean":"2024-09-17T04:23:26.656896+0000","last_became_active":"2024-09-17T04:23:25.366943+0000","last_became_peered":"2024-09-17T04:23:25.366943+0000","last_unstale":"2024-09-17T04:23:26.656896+0000","last_undegraded":"2024-09-17T04:23:26.656896+0000","last_fullsized":"2024-09-17T04:23:26.656896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:01.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.356691+0000","last_change":"2024-09-17T04:23:24.356270+0000","last_active":"2024-09-17T04:23:26.356691+0000","last_peered":"2024-09-17T04:23:26.356691+0000","last_clean":"2024-09-17T04:23:26.356691+0000","last_became_active":"2024-09-17T04:23:24.355920+0000","last_became_peered":"2024-09-17T04:23:24.355920+0000","last_unstale":"2024-09-17T04:23:26.356691+0000","last_undegraded":"2024-09-17T04:23:26.356691+0000","last_fullsized":"2024-09-17T04:23:26.356691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:42.867920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657231+0000","last_change":"2024-09-17T04:23:25.366947+0000","last_active":"2024-09-17T04:23:26.657231+0000","last_peered":"2024-09-17T04:23:26.657231+0000","last_clean":"2024-09-17T04:23:26.657231+0000","last_became_active":"2024-09-17T04:23:25.366593+0000","last_became_peered":"2024-09-17T04:23:25.366593+0000","last_unstale":"2024-09-17T04:23:26.657231+0000","last_undegraded":"2024-09-17T04:23:26.657231+0000","last_fullsized":"2024-09-17T04:23:26.657231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:32.638076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659143+0000","last_change":"2024-09-17T04:23:24.351819+0000","last_active":"2024-09-17T04:23:26.659143+0000","last_peered":"2024-09-17T04:23:26.659143+0000","last_clean":"2024-09-17T04:23:26.659143+0000","last_became_active":"2024-09-17T04:23:24.351483+0000","last_became_peered":"2024-09-17T04:23:24.351483+0000","last_unstale":"2024-09-17T04:23:26.659143+0000","last_undegraded":"2024-09-17T04:23:26.659143+0000","last_fullsized":"2024-09-17T04:23:26.659143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:18.736197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.468638+0000","last_change":"2024-09-17T04:23:25.369382+0000","last_active":"2024-09-17T04:23:26.468638+0000","last_peered":"2024-09-17T04:23:26.468638+0000","last_clean":"2024-09-17T04:23:26.468638+0000","last_became_active":"2024-09-17T04:23:25.369026+0000","last_became_peered":"2024-09-17T04:23:25.369026+0000","last_unstale":"2024-09-17T04:23:26.468638+0000","last_undegraded":"2024-09-17T04:23:26.468638+0000","last_fullsized":"2024-09-17T04:23:26.468638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.361738+0000","last_change":"2024-09-17T04:23:25.354786+0000","last_active":"2024-09-17T04:23:26.361738+0000","last_peered":"2024-09-17T04:23:26.361738+0000","last_clean":"2024-09-17T04:23:26.361738+0000","last_became_active":"2024-09-17T04:23:25.354470+0000","last_became_peered":"2024-09-17T04:23:25.354470+0000","last_unstale":"2024-09-17T04:23:26.361738+0000","last_undegraded":"2024-09-17T04:23:26.361738+0000","last_fullsized":"2024-09-17T04:23:26.361738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:38.052948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.658625+0000","last_change":"2024-09-17T04:23:24.349161+0000","last_active":"2024-09-17T04:23:26.658625+0000","last_peered":"2024-09-17T04:23:26.658625+0000","last_clean":"2024-09-17T04:23:26.658625+0000","last_became_active":"2024-09-17T04:23:24.348825+0000","last_became_peered":"2024-09-17T04:23:24.348825+0000","last_unstale":"2024-09-17T04:23:26.658625+0000","last_undegraded":"2024-09-17T04:23:26.658625+0000","last_fullsized":"2024-09-17T04:23:26.658625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:29.666124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.362110+0000","last_change":"2024-09-17T04:23:25.354992+0000","last_active":"2024-09-17T04:23:26.362110+0000","last_peered":"2024-09-17T04:23:26.362110+0000","last_clean":"2024-09-17T04:23:26.362110+0000","last_became_active":"2024-09-17T04:23:25.354647+0000","last_became_peered":"2024-09-17T04:23:25.354647+0000","last_unstale":"2024-09-17T04:23:26.362110+0000","last_undegraded":"2024-09-17T04:23:26.362110+0000","last_fullsized":"2024-09-17T04:23:26.362110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.501127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.659219+0000","last_change":"2024-09-17T04:23:24.353160+0000","last_active":"2024-09-17T04:23:26.659219+0000","last_peered":"2024-09-17T04:23:26.659219+0000","last_clean":"2024-09-17T04:23:26.659219+0000","last_became_active":"2024-09-17T04:23:24.352829+0000","last_became_peered":"2024-09-17T04:23:24.352829+0000","last_unstale":"2024-09-17T04:23:26.659219+0000","last_undegraded":"2024-09-17T04:23:26.659219+0000","last_fullsized":"2024-09-17T04:23:26.659219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:06.640618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657688+0000","last_change":"2024-09-17T04:23:25.370271+0000","last_active":"2024-09-17T04:23:26.657688+0000","last_peered":"2024-09-17T04:23:26.657688+0000","last_clean":"2024-09-17T04:23:26.657688+0000","last_became_active":"2024-09-17T04:23:25.369591+0000","last_became_peered":"2024-09-17T04:23:25.369591+0000","last_unstale":"2024-09-17T04:23:26.657688+0000","last_undegraded":"2024-09-17T04:23:26.657688+0000","last_fullsized":"2024-09-17T04:23:26.657688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:27.708692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656558+0000","last_change":"2024-09-17T04:23:24.356821+0000","last_active":"2024-09-17T04:23:26.656558+0000","last_peered":"2024-09-17T04:23:26.656558+0000","last_clean":"2024-09-17T04:23:26.656558+0000","last_became_active":"2024-09-17T04:23:24.356475+0000","last_became_peered":"2024-09-17T04:23:24.356475+0000","last_unstale":"2024-09-17T04:23:26.656558+0000","last_undegraded":"2024-09-17T04:23:26.656558+0000","last_fullsized":"2024-09-17T04:23:26.656558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:42.496632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.656387+0000","last_change":"2024-09-17T04:23:25.364361+0000","last_active":"2024-09-17T04:23:26.656387+0000","last_peered":"2024-09-17T04:23:26.656387+0000","last_clean":"2024-09-17T04:23:26.656387+0000","last_became_active":"2024-09-17T04:23:25.363990+0000","last_became_peered":"2024-09-17T04:23:25.363990+0000","last_unstale":"2024-09-17T04:23:26.656387+0000","last_undegraded":"2024-09-17T04:23:26.656387+0000","last_fullsized":"2024-09-17T04:23:26.656387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:24.326807+0000","last_clean_scrub_stamp":"2024-09-17T04:23:24.326807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:50.778437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T04:23:26.657778+0000","last_change":"2024-09-17T04:23:24.349646+0000","last_active":"2024-09-17T04:23:26.657778+0000","last_peered":"2024-09-17T04:23:26.657778+0000","last_clean":"2024-09-17T04:23:26.657778+0000","last_became_active":"2024-09-17T04:23:24.349309+0000","last_became_peered":"2024-09-17T04:23:24.349309+0000","last_unstale":"2024-09-17T04:23:26.657778+0000","last_undegraded":"2024-09-17T04:23:26.657778+0000","last_fullsized":"2024-09-17T04:23:26.657778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:23.321395+0000","last_clean_scrub_stamp":"2024-09-17T04:23:23.321395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:33.135083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:23:37.536 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:23:37.537 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T04:23:37.537 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T04:23:37.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 -- 172.21.15.63:0/3622576596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380cf680 msgr2=0x7f013806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 --2- 172.21.15.63:0/3622576596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380cf680 0x7f013806eee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0128009830 tx=0x7f012802a510 comp rx=0 tx=0).stop 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 -- 172.21.15.63:0/3622576596 shutdown_connections 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 --2- 172.21.15.63:0/3622576596 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380cf680 0x7f013806eee0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 --2- 172.21.15.63:0/3622576596 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380b96c0 0x7f01380cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 -- 172.21.15.63:0/3622576596 >> 172.21.15.63:0/3622576596 conn(0x7f013809d8c0 msgr2=0x7f013808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 -- 172.21.15.63:0/3622576596 shutdown_connections 2024-09-17T04:23:37.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.689+0000 7f013fbad640 1 -- 172.21.15.63:0/3622576596 wait complete. 2024-09-17T04:23:37.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.690+0000 7f013fbad640 1 Processor -- start 2024-09-17T04:23:37.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.691+0000 7f013fbad640 1 -- start start 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380b96c0 0x7f0138159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380cf680 0x7f013815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01380b6840 con 0x7f013806f420 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f01380b66c0 con 0x7f01380b96c0 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013fbad640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f01380b69c0 con 0x7f01380cf680 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36348/0 (socket says 172.21.15.63:36348) 2024-09-17T04:23:37.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 -- 172.21.15.63:0/2044241523 learned_addr learned my addr 172.21.15.63:0/2044241523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d148640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380b96c0 0x7f0138159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013e14a640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380cf680 0x7f013815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 -- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380cf680 msgr2=0x7f013815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380cf680 0x7f013815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 -- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380b96c0 msgr2=0x7f0138159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380b96c0 0x7f0138159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 -- 172.21.15.63:0/2044241523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013815f180 con 0x7f013806f420 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.692+0000 7f013d949640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f013400e9f0 tx=0x7f013400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.693+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013400cd80 con 0x7f013806f420 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.693+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0134004020 con 0x7f013806f420 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.693+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013815f460 con 0x7f013806f420 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.693+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134004470 con 0x7f013806f420 2024-09-17T04:23:37.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.693+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013815ec20 con 0x7f013806f420 2024-09-17T04:23:37.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.694+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013815f6a0 con 0x7f013806f420 2024-09-17T04:23:37.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.694+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0134005030 con 0x7f013806f420 2024-09-17T04:23:37.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.695+0000 7f012e7fc640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 0x7f011c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:37.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.695+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f013409b720 con 0x7f013806f420 2024-09-17T04:23:37.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.695+0000 7f013d148640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 0x7f011c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:37.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.696+0000 7f013d148640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 0x7f011c07b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f0128004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:37.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.699+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f013815f6a0 con 0x7f013806f420 2024-09-17T04:23:37.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.923+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f01380cf140 con 0x7f013806f420 2024-09-17T04:23:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.923+0000 7f012e7fc640 1 -- 172.21.15.63:0/2044241523 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0134063ae0 con 0x7f013806f420 2024-09-17T04:23:37.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:37.923 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 msgr2=0x7f011c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 0x7f011c07b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f0128004730 comp rx=0 tx=0).stop 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 msgr2=0x7f013815e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f013400e9f0 tx=0x7f013400eeb0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 shutdown_connections 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f011c078bc0 0x7f011c07b0d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f01380b96c0 0x7f0138159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f01380cf680 0x7f013815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 --2- 172.21.15.63:0/2044241523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f013806f420 0x7f013815e6e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 >> 172.21.15.63:0/2044241523 conn(0x7f013809d8c0 msgr2=0x7f01380b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 shutdown_connections 2024-09-17T04:23:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:37.925+0000 7f013fbad640 1 -- 172.21.15.63:0/2044241523 wait complete. 2024-09-17T04:23:37.936 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T04:23:37.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:38.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/108879829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80d1a80 msgr2=0x7f7bd80cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/108879829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80d1a80 0x7f7bd80cf090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009830 tx=0x7f7bcc02a510 comp rx=0 tx=0).stop 2024-09-17T04:23:38.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/108879829 shutdown_connections 2024-09-17T04:23:38.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/108879829 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80cf5d0 0x7f7bd80cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/108879829 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80d1a80 0x7f7bd80cf090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/108879829 >> 172.21.15.63:0/108879829 conn(0x7f7bd808bfc0 msgr2=0x7f7bd809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/108879829 shutdown_connections 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.054+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/108879829 wait complete. 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.056+0000 7f7bdd6d5640 1 Processor -- start 2024-09-17T04:23:38.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.056+0000 7f7bdd6d5640 1 -- start start 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80cf5d0 0x7f7bd80a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80d1a80 0x7f7bd81f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8162c60 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8162ae0 con 0x7f7bd80cf5d0 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bdd6d5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd8162de0 con 0x7f7bd80d1a80 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bd77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36364/0 (socket says 172.21.15.63:36364) 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.057+0000 7f7bd77fe640 1 -- 172.21.15.63:0/3241918550 learned_addr learned my addr 172.21.15.63:0/3241918550 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd6ffd640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80cf5d0 0x7f7bd80a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd67fc640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80d1a80 0x7f7bd81f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 -- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80d1a80 msgr2=0x7f7bd81f9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80d1a80 0x7f7bd81f9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 -- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80cf5d0 msgr2=0x7f7bd80a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80cf5d0 0x7f7bd80a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 -- 172.21.15.63:0/3241918550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd80ca410 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bd77fe640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000ea10 tx=0x7f7bd000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000cde0 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bd0004c10 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd80ca8b0 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0005020 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.058+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd81f9480 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.059+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd8163370 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.060+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bd00051c0 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.061+0000 7f7bbf7fe640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 0x7f7bc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.061+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd009bb60 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.061+0000 7f7bd6ffd640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 0x7f7bc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.061+0000 7f7bd6ffd640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 0x7f7bc407b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8001610 tx=0x7f7bc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.065+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bd0063fa0 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.287+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bd80b4020 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.288+0000 7f7bbf7fe640 1 -- 172.21.15.63:0/3241918550 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f7bd00638a0 con 0x7f7bd80d2ed0 2024-09-17T04:23:38.288 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:38.288 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:38.288 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 msgr2=0x7f7bc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 0x7f7bc407b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8001610 tx=0x7f7bc8009040 comp rx=0 tx=0).stop 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 msgr2=0x7f7bd815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000ea10 tx=0x7f7bd000eed0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 shutdown_connections 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7bc4078b90 0x7f7bc407b0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd80d2ed0 0x7f7bd815e8a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7bd80d1a80 0x7f7bd81f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 --2- 172.21.15.63:0/3241918550 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7bd80cf5d0 0x7f7bd80a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 >> 172.21.15.63:0/3241918550 conn(0x7f7bd808bfc0 msgr2=0x7f7bd80b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 shutdown_connections 2024-09-17T04:23:38.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.290+0000 7f7bdd6d5640 1 -- 172.21.15.63:0/3241918550 wait complete. 2024-09-17T04:23:38.301 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 -- 172.21.15.63:0/1764459702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580b96c0 msgr2=0x7f50580cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 --2- 172.21.15.63:0/1764459702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580b96c0 0x7f50580cf140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50580d3f30 tx=0x7f504802a540 comp rx=0 tx=0).stop 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 -- 172.21.15.63:0/1764459702 shutdown_connections 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 --2- 172.21.15.63:0/1764459702 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 0x7f50580b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 --2- 172.21.15.63:0/1764459702 >> v2:172.21.15.112:3300/0 conn(0x7f50580cf680 0x7f505806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 --2- 172.21.15.63:0/1764459702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580b96c0 0x7f50580cf140 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 -- 172.21.15.63:0/1764459702 >> 172.21.15.63:0/1764459702 conn(0x7f505809d8c0 msgr2=0x7f505808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 -- 172.21.15.63:0/1764459702 shutdown_connections 2024-09-17T04:23:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.417+0000 7f505f0de640 1 -- 172.21.15.63:0/1764459702 wait complete. 2024-09-17T04:23:38.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.419+0000 7f505f0de640 1 Processor -- start 2024-09-17T04:23:38.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.419+0000 7f505f0de640 1 -- start start 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 0x7f50580cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 0x7f5058153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50580b3e10 con 0x7f50580cf680 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f50580b64f0 con 0x7f50580b96c0 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505f0de640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f50581536c0 con 0x7f505806f420 2024-09-17T04:23:38.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36384/0 (socket says 172.21.15.63:36384) 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 -- 172.21.15.63:0/2305987472 learned_addr learned my addr 172.21.15.63:0/2305987472 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505ce7a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 0x7f50580cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f5057fff640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 0x7f5058153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 -- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 msgr2=0x7f50580cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 0x7f50580cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 -- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 msgr2=0x7f5058153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 0x7f5058153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 -- 172.21.15.63:0/2305987472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5058154720 con 0x7f50580cf680 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f5057fff640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 0x7f5058153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:38.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.421+0000 7f505d67b640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f505000b9e0 tx=0x7f505000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.422+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050019070 con 0x7f50580cf680 2024-09-17T04:23:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.422+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f505000cc10 con 0x7f50580cf680 2024-09-17T04:23:38.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.422+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50581518a0 con 0x7f50580cf680 2024-09-17T04:23:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.422+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50500146a0 con 0x7f50580cf680 2024-09-17T04:23:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.422+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5058151e60 con 0x7f50580cf680 2024-09-17T04:23:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.423+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50580b6ae0 con 0x7f50580cf680 2024-09-17T04:23:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.424+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f505001c070 con 0x7f50580cf680 2024-09-17T04:23:38.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.424+0000 7f50557fa640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.424+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f505009a930 con 0x7f50580cf680 2024-09-17T04:23:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.424+0000 7f505ce7a640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.425+0000 7f505ce7a640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 0x7f504407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5048034000 tx=0x7f5048004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.429+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50500627b0 con 0x7f50580cf680 2024-09-17T04:23:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.652+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f505806cde0 con 0x7f50580cf680 2024-09-17T04:23:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.653+0000 7f50557fa640 1 -- 172.21.15.63:0/2305987472 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f50500671e0 con 0x7f50580cf680 2024-09-17T04:23:38.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:38.653 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:38.653 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 msgr2=0x7f504407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 0x7f504407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5048034000 tx=0x7f5048004730 comp rx=0 tx=0).stop 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 msgr2=0x7f5058153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f505000b9e0 tx=0x7f505000bea0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 shutdown_connections 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5044078b90 0x7f504407b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f50580b96c0 0x7f5058153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50580cf680 0x7f5058153e70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 --2- 172.21.15.63:0/2305987472 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f505806f420 0x7f50580cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 >> 172.21.15.63:0/2305987472 conn(0x7f505809d8c0 msgr2=0x7f505808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 shutdown_connections 2024-09-17T04:23:38.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.655+0000 7f505f0de640 1 -- 172.21.15.63:0/2305987472 wait complete. 2024-09-17T04:23:38.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:38.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 -- 172.21.15.63:0/172081007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24880b66b0 msgr2=0x7f24880b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 --2- 172.21.15.63:0/172081007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24880b66b0 0x7f24880b3710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2478009830 tx=0x7f247802a540 comp rx=0 tx=0).stop 2024-09-17T04:23:38.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 -- 172.21.15.63:0/172081007 shutdown_connections 2024-09-17T04:23:38.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 --2- 172.21.15.63:0/172081007 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24880b66b0 0x7f24880b3710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 -- 172.21.15.63:0/172081007 >> 172.21.15.63:0/172081007 conn(0x7f248809d7f0 msgr2=0x7f24880d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 -- 172.21.15.63:0/172081007 shutdown_connections 2024-09-17T04:23:38.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.786+0000 7f248fa7e640 1 -- 172.21.15.63:0/172081007 wait complete. 2024-09-17T04:23:38.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.788+0000 7f248fa7e640 1 Processor -- start 2024-09-17T04:23:38.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.788+0000 7f248fa7e640 1 -- start start 2024-09-17T04:23:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 0x7f2488160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248809f170 0x7f24880c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f248806ec00 con 0x7f24880b9970 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24880d5010 con 0x7f248809f170 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248fa7e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f248806ed80 con 0x7f248806e0e0 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248d019640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248d019640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36396/0 (socket says 172.21.15.63:36396) 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.789+0000 7f248d019640 1 -- 172.21.15.63:0/2529149305 learned_addr learned my addr 172.21.15.63:0/2529149305 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248e01b640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248809f170 0x7f24880c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d81a640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 0x7f2488160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 -- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 msgr2=0x7f2488160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 0x7f2488160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 -- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248809f170 msgr2=0x7f24880c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248809f170 0x7f24880c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 -- 172.21.15.63:0/2529149305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24880cc7a0 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d81a640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 0x7f2488160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248d019640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f247802ab30 tx=0x7f2478003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478005c90 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24880cb700 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2478005020 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478005450 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.790+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880cbcc0 con 0x7f24880b9970 2024-09-17T04:23:38.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.791+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248806f230 con 0x7f24880b9970 2024-09-17T04:23:38.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.792+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24780317c0 con 0x7f24880b9970 2024-09-17T04:23:38.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.793+0000 7f247e7fc640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:38.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.793+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24780bc260 con 0x7f24880b9970 2024-09-17T04:23:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.793+0000 7f248d81a640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.793+0000 7f248d81a640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 0x7f246c07b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2484000fb0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.796+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f247803f030 con 0x7f24880b9970 2024-09-17T04:23:38.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.983+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f248809f680 con 0x7f24880b9970 2024-09-17T04:23:38.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.984+0000 7f247e7fc640 1 -- 172.21.15.63:0/2529149305 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f24780846a0 con 0x7f24880b9970 2024-09-17T04:23:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:38.985 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:38.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 msgr2=0x7f246c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 0x7f246c07b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2484000fb0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 msgr2=0x7f248809ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f247802ab30 tx=0x7f2478003c10 comp rx=0 tx=0).stop 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 shutdown_connections 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f246c078bc0 0x7f246c07b0d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f248809f170 0x7f24880c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24880b9970 0x7f248809ec30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 --2- 172.21.15.63:0/2529149305 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f248806e0e0 0x7f2488160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:38.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 >> 172.21.15.63:0/2529149305 conn(0x7f248809d7f0 msgr2=0x7f24880b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:38.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 shutdown_connections 2024-09-17T04:23:38.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:38.987+0000 7f248fa7e640 1 -- 172.21.15.63:0/2529149305 wait complete. 2024-09-17T04:23:38.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 -- 172.21.15.63:0/1069945065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280d0ce0 msgr2=0x7f51280b9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 --2- 172.21.15.63:0/1069945065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280d0ce0 0x7f51280b9be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f512808e380 tx=0x7f511802a5f0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 -- 172.21.15.63:0/1069945065 shutdown_connections 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 --2- 172.21.15.63:0/1069945065 >> v2:172.21.15.112:3300/0 conn(0x7f51280d4c20 0x7f51280b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 --2- 172.21.15.63:0/1069945065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280d0ce0 0x7f51280b9be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 -- 172.21.15.63:0/1069945065 >> 172.21.15.63:0/1069945065 conn(0x7f512808bfc0 msgr2=0x7f512809d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 -- 172.21.15.63:0/1069945065 shutdown_connections 2024-09-17T04:23:39.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.117+0000 7f512e8e5640 1 -- 172.21.15.63:0/1069945065 wait complete. 2024-09-17T04:23:39.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.118+0000 7f512e8e5640 1 Processor -- start 2024-09-17T04:23:39.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.119+0000 7f512e8e5640 1 -- start start 2024-09-17T04:23:39.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51280d0ce0 0x7f512809ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51280cb650 0x7f512815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f51280b4a00 con 0x7f51280cf0b0 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f51280b4880 con 0x7f51280d0ce0 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512e8e5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f51280b4b80 con 0x7f51280cb650 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36416/0 (socket says 172.21.15.63:36416) 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 -- 172.21.15.63:0/3800751577 learned_addr learned my addr 172.21.15.63:0/3800751577 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f51277fe640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51280d0ce0 0x7f512809ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f512ce82640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51280cb650 0x7f512815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 -- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51280cb650 msgr2=0x7f512815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51280cb650 0x7f512815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 -- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51280d0ce0 msgr2=0x7f512809ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51280d0ce0 0x7f512809ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.120+0000 7f5127fff640 1 -- 172.21.15.63:0/3800751577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51280a1ff0 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f5127fff640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5118034040 tx=0x7f51180039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511803e030 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51180047a0 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512809e1e0 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118035040 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.121+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51280ce380 con 0x7f51280cf0b0 2024-09-17T04:23:39.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.122+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51280b50e0 con 0x7f51280cf0b0 2024-09-17T04:23:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.122+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5118041030 con 0x7f51280cf0b0 2024-09-17T04:23:39.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.123+0000 7f5124ff9640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 0x7f511407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.123+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f51180bb520 con 0x7f51280cf0b0 2024-09-17T04:23:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.123+0000 7f51277fe640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 0x7f511407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.124+0000 7f51277fe640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 0x7f511407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51281efd60 tx=0x7f511c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.128+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f51180833a0 con 0x7f51280cf0b0 2024-09-17T04:23:39.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.348+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51280b7d10 con 0x7f51280cf0b0 2024-09-17T04:23:39.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.349+0000 7f5124ff9640 1 -- 172.21.15.63:0/3800751577 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f5118087dd0 con 0x7f51280cf0b0 2024-09-17T04:23:39.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:39.349 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:39.349 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 msgr2=0x7f511407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 0x7f511407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f51281efd60 tx=0x7f511c009040 comp rx=0 tx=0).stop 2024-09-17T04:23:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 msgr2=0x7f51281f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5118034040 tx=0x7f51180039e0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 shutdown_connections 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5114078bc0 0x7f511407b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f51280d0ce0 0x7f512809ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f51280cb650 0x7f512815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 --2- 172.21.15.63:0/3800751577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51280cf0b0 0x7f51281f6200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 >> 172.21.15.63:0/3800751577 conn(0x7f512808bfc0 msgr2=0x7f512806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 shutdown_connections 2024-09-17T04:23:39.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.351+0000 7f512e8e5640 1 -- 172.21.15.63:0/3800751577 wait complete. 2024-09-17T04:23:39.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:23:24.713173+0000', 'modified': '2024-09-17T04:23:27.760800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4393}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4393': {'gid': 4393, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.112:6836/3142788505', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6835', 'nonce': 3142788505}, {'type': 'v1', 'addr': '172.21.15.112:6836', 'nonce': 3142788505}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4393, 'qdb_cluster': [4393]} 2024-09-17T04:23:39.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T04:23:39.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T04:23:39.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.885+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3394441329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 msgr2=0x7fdfb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.885+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3394441329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfb0004c10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0016c0 tx=0x7fdfb0005830 comp rx=0 tx=0).stop 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.885+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3394441329 shutdown_connections 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.886+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3394441329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfb0004c10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.886+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3394441329 >> 172.21.15.63:0/3394441329 conn(0x7fdfc409d7f0 msgr2=0x7fdfc40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.886+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3394441329 shutdown_connections 2024-09-17T04:23:39.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.886+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3394441329 wait complete. 2024-09-17T04:23:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.887+0000 7fdfc8f6e640 1 Processor -- start 2024-09-17T04:23:39.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.888+0000 7fdfc8f6e640 1 -- start start 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc41f5160 0x7fdfc41f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41f5ab0 0x7fdfc40ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40b6120 con 0x7fdfb0004800 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc40b5fa0 con 0x7fdfc41f5160 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc8f6e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc40b62a0 con 0x7fdfc41f5ab0 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36430/0 (socket says 172.21.15.63:36430) 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 -- 172.21.15.63:0/3730398043 learned_addr learned my addr 172.21.15.63:0/3730398043 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41f5ab0 0x7fdfc40ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc41f5160 0x7fdfc41f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 -- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41f5ab0 msgr2=0x7fdfc40ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41f5ab0 0x7fdfc40ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 -- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc41f5160 msgr2=0x7fdfc41f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc41f5160 0x7fdfc41f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 -- 172.21.15.63:0/3730398043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41f95d0 con 0x7fdfb0004800 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.889+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0063d0 tx=0x7fdfbc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.890+0000 7fdfbaffd640 1 -- 172.21.15.63:0/3730398043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc015070 con 0x7fdfb0004800 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.890+0000 7fdfbaffd640 1 -- 172.21.15.63:0/3730398043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfbc011860 con 0x7fdfb0004800 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.890+0000 7fdfbaffd640 1 -- 172.21.15.63:0/3730398043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc011cb0 con 0x7fdfb0004800 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.890+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41f8810 con 0x7fdfb0004800 2024-09-17T04:23:39.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.890+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41f8dd0 con 0x7fdfb0004800 2024-09-17T04:23:39.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.892+0000 7fdfbaffd640 1 -- 172.21.15.63:0/3730398043 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfbc018070 con 0x7fdfb0004800 2024-09-17T04:23:39.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfbaffd640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 0x7fdfa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfbaffd640 1 -- 172.21.15.63:0/3730398043 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfbc09b600 con 0x7fdfb0004800 2024-09-17T04:23:39.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 0x7fdfa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfcffba740 1 Processor -- start 2024-09-17T04:23:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 0x7fdfa407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfac032000 tx=0x7fdfac02c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.893+0000 7fdfcffba740 1 -- start start 2024-09-17T04:23:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765a53b0 0x55fc769a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765ad590 0x55fc769bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fc768e8820 con 0x55fc765ce270 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fc768d7c50 con 0x55fc765a53b0 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fc768dba60 con 0x55fc765ad590 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36436/0 (socket says 172.21.15.63:36436) 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 -- 172.21.15.63:0/3194074923 learned_addr learned my addr 172.21.15.63:0/3194074923 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765ad590 0x55fc769bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765a53b0 0x55fc769a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 -- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765ad590 msgr2=0x55fc769bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765ad590 0x55fc769bd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 -- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765a53b0 msgr2=0x55fc769a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765a53b0 0x55fc769a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 -- 172.21.15.63:0/3194074923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc76639850 con 0x55fc765ce270 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc099b50 tx=0x7fdfbc05fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212bd28e036a2c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfa3fff640 1 -- 172.21.15.63:0/3194074923 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc01f030 con 0x55fc765ce270 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfa3fff640 1 -- 172.21.15.63:0/3194074923 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfbc06cce0 con 0x55fc765ce270 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.895+0000 7fdfa3fff640 1 -- 172.21.15.63:0/3194074923 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc085b40 con 0x55fc765ce270 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 -- 172.21.15.63:0/3194074923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 msgr2=0x55fc7699ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc099b50 tx=0x7fdfbc05fb80 comp rx=0 tx=0).stop 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 -- 172.21.15.63:0/3194074923 shutdown_connections 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765a53b0 0x55fc769a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765ad590 0x55fc769bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3194074923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ffc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 -- 172.21.15.63:0/3194074923 >> 172.21.15.63:0/3194074923 conn(0x55fc765c23c0 msgr2=0x55fc76976280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 -- 172.21.15.63:0/3194074923 shutdown_connections 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.896+0000 7fdfcffba740 1 -- 172.21.15.63:0/3194074923 wait complete. 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.897+0000 7fdfcffba740 1 -- start start 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.897+0000 7fdfcffba740 1 Processor -- start 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 0x55fc769ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc7698e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fc76648620 con 0x55fc765ce270 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fc7687d5f0 con 0x55fc765ad590 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fc769a0a40 con 0x55fc765a53b0 2024-09-17T04:23:39.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfcffba740 10 client.0 _ll_register_callbacks cb 0x55fc768810a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36450/0 (socket says 172.21.15.63:36450) 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 -- 172.21.15.63:0/41346996 learned_addr learned my addr 172.21.15.63:0/41346996 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc7698e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc259c640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 0x55fc769ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 -- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 msgr2=0x55fc769ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 0x55fc769ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 -- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 msgr2=0x55fc7698e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc7698e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 -- 172.21.15.63:0/41346996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc766b06b0 con 0x55fc765ce270 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc259c640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 0x55fc769ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:39.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc7698e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4005fd0 tx=0x7fdfb400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafdad303cf65c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.899+0000 7fdfa17fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4003b70 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfb4003d10 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfbc06cce0 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdfb4025050 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 10 client.4665 fetch_fsmap learned FSMap version 8 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fc769bb680 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfbc06cce0 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fdfb4028020 con 0x55fc765ce270 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 10 client.4665 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T04:23:39.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 20 client.4665 populate_metadata read hostname 'smithi063' 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc7658ce40 0x55fc769ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 4 client.4665 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 --> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc768ea770 con 0x55fc7658ce40 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.900+0000 7fdfc259c640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc7658ce40 0x55fc769ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.901+0000 7fdfa17fa640 10 client.4665 ms_handle_connect on v2:172.21.15.112:6835/3142788505 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.901+0000 7fdfc259c640 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc7658ce40 0x55fc769ca0b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ce7068ff325f1b3 server_cookie=3ae93cd2618c0c13 in_seq=0 out_seq=0 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfa17fa640 1 -- 172.21.15.63:0/41346996 <== mds.0 v2:172.21.15.112:6835/3142788505 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc768ea770 con 0x55fc7658ce40 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfa17fa640 10 client.4665 handle_command_reply: tid=0 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 client.4665 shutdown 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 msgr2=0x55fc7699ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4005fd0 tx=0x7fdfb400f790 comp rx=0 tx=0).stop 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 shutdown_connections 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc7658ce40 0x55fc769ca0b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc7698e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765ce270 0x55fc7699ee70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfa17fa640 0 client.4665 ms_handle_reset on v2:172.21.15.112:6835/3142788505 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 --2- 172.21.15.63:0/41346996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc765a53b0 0x55fc769ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 >> 172.21.15.63:0/41346996 conn(0x55fc765c23c0 msgr2=0x55fc769bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 shutdown_connections 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 1 -- 172.21.15.63:0/41346996 wait complete. 2024-09-17T04:23:39.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.902+0000 7fdfcffba740 20 client.4665 trim_cache size 0 max 16384 2024-09-17T04:23:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.921+0000 7fdfcffba740 1 Processor -- start 2024-09-17T04:23:39.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.921+0000 7fdfcffba740 1 -- start start 2024-09-17T04:23:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc769bac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc42011b0 con 0x55fc765a53b0 2024-09-17T04:23:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4160e40 con 0x55fc765ad590 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc4200b60 con 0x55fc7658ce40 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36454/0 (socket says 172.21.15.63:36454) 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3604172334 learned_addr learned my addr 172.21.15.63:0/3604172334 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc769bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 msgr2=0x55fc769bac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc769bac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 msgr2=0x55fc769a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3604172334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc769b5ad0 con 0x55fc765a53b0 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc769bac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:39.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.922+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfac02c010 tx=0x7fdfac03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd149e2034f55b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfa37fe640 1 -- 172.21.15.63:0/3604172334 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003cc0 con 0x55fc765a53b0 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfa37fe640 1 -- 172.21.15.63:0/3604172334 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfac051070 con 0x55fc765a53b0 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfa37fe640 1 -- 172.21.15.63:0/3604172334 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac04c6b0 con 0x55fc765a53b0 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 -- 172.21.15.63:0/3604172334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 msgr2=0x55fc7699fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdfac02c010 tx=0x7fdfac03b000 comp rx=0 tx=0).stop 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 -- 172.21.15.63:0/3604172334 shutdown_connections 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc7699fbb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3604172334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc769bac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 -- 172.21.15.63:0/3604172334 >> 172.21.15.63:0/3604172334 conn(0x55fc765c23c0 msgr2=0x55fc769b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 -- 172.21.15.63:0/3604172334 shutdown_connections 2024-09-17T04:23:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.923+0000 7fdfcffba740 1 -- 172.21.15.63:0/3604172334 wait complete. 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.924+0000 7fdfcffba740 1 -- start start 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.924+0000 7fdfcffba740 1 Processor -- start 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc76a3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fc7698ecb0 con 0x55fc765a53b0 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x55fc769bb960 con 0x55fc765ad590 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x55fc769b2040 con 0x55fc7658ce40 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfcffba740 10 client.0 _ll_register_callbacks cb 0x7fdfb4009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:23:39.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36468/0 (socket says 172.21.15.63:36468) 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3031557461 learned_addr learned my addr 172.21.15.63:0/3031557461 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc76a3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 msgr2=0x55fc76a3b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc76a3b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 msgr2=0x55fc769b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 -- 172.21.15.63:0/3031557461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc769a0900 con 0x55fc765a53b0 2024-09-17T04:23:39.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc2d9d640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc76a3b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfc1d9b640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0061f0 tx=0x7fdfac04c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ac9c317fd54674 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.926+0000 7fdfa17fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac05a020 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfac03e460 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfac051070 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdfac064050 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 10 client.4671 fetch_fsmap learned FSMap version 8 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fc76a3a660 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfac051070 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fdfac067020 con 0x55fc765a53b0 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T04:23:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 20 client.4671 populate_metadata read hostname 'smithi063' 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc76562280 0x55fc769bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 4 client.4671 mds_command: new command op to 4393 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 --> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] -- command(tid 0: {"prefix": "status"}) -- 0x55fc768e6220 con 0x55fc76562280 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.927+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc76562280 0x55fc769bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfa17fa640 10 client.4671 ms_handle_connect on v2:172.21.15.112:6835/3142788505 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfc259c640 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc76562280 0x55fc769bcef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1627a286afa06867 server_cookie=9c469fe3d03e4fc0 in_seq=0 out_seq=0 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfa17fa640 1 -- 172.21.15.63:0/3031557461 <== mds.0 v2:172.21.15.112:6835/3142788505 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fc768e6220 con 0x55fc76562280 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfa17fa640 10 client.4671 handle_command_reply: tid=0 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 client.4671 shutdown 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 msgr2=0x55fc769a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0061f0 tx=0x7fdfac04c8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 shutdown_connections 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:6835/3142788505,v1:172.21.15.112:6836/3142788505] conn(0x55fc76562280 0x55fc769bcef0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x55fc765ad590 0x55fc769b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fc765a53b0 0x55fc769a03c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 --2- 172.21.15.63:0/3031557461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x55fc7658ce40 0x55fc76a3b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfa17fa640 0 client.4671 ms_handle_reset on v2:172.21.15.112:6835/3142788505 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 >> 172.21.15.63:0/3031557461 conn(0x55fc765c23c0 msgr2=0x55fc7698e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 shutdown_connections 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 1 -- 172.21.15.63:0/3031557461 wait complete. 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.928+0000 7fdfcffba740 20 client.4671 trim_cache size 0 max 16384 2024-09-17T04:23:39.934 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "2184e050-2c9d-47fc-8e14-c53eccd8cf79", 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4393, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 14.572554682, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 8, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 21, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 21, 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 20.613224039999999 2024-09-17T04:23:39.935 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:23:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 msgr2=0x7fdfa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 0x7fdfa407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfac032000 tx=0x7fdfac02c040 comp rx=0 tx=0).stop 2024-09-17T04:23:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 msgr2=0x7fdfc40cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0063d0 tx=0x7fdfbc0039c0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 shutdown_connections 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdfa4078b90 0x7fdfa407b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdfc41f5160 0x7fdfc41f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdfc41f5ab0 0x7fdfc40ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 --2- 172.21.15.63:0/3730398043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfb0004800 0x7fdfc40cdde0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 >> 172.21.15.63:0/3730398043 conn(0x7fdfc409d7f0 msgr2=0x7fdfc415ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 shutdown_connections 2024-09-17T04:23:39.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:39.929+0000 7fdfc8f6e640 1 -- 172.21.15.63:0/3730398043 wait complete. 2024-09-17T04:23:39.940 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T04:23:39.967 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T04:23:39.967 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T04:23:39.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:39.967 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:23:39.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:39.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T04:23:40.052 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-17T04:23:40.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:23:40.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.054 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:23:40.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T04:23:40.178 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-17T04:23:40.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:23:40.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.180 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:23:40.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-17T04:23:40.270 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-17T04:23:40.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:23:40.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.272 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:23:40.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-17T04:23:40.396 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-17T04:23:40.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:23:40.398 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T04:23:40.398 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:23:40.398 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:23:40.398 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:23:40.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.515+0000 7f14e6d4a640 1 -- 172.21.15.63:0/1034730926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e015c580 msgr2=0x7f14e0070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:40.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.515+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/1034730926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e015c580 0x7f14e0070540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009830 tx=0x7f14d002a510 comp rx=0 tx=0).stop 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 -- 172.21.15.63:0/1034730926 shutdown_connections 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/1034730926 >> v2:172.21.15.112:3300/0 conn(0x7f14e0155ce0 0x7f14e00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/1034730926 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e015c580 0x7f14e0070540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 -- 172.21.15.63:0/1034730926 >> 172.21.15.63:0/1034730926 conn(0x7f14e006def0 msgr2=0x7f14e006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 -- 172.21.15.63:0/1034730926 shutdown_connections 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.516+0000 7f14e6d4a640 1 -- 172.21.15.63:0/1034730926 wait complete. 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.517+0000 7f14e6d4a640 1 Processor -- start 2024-09-17T04:23:40.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.517+0000 7f14e6d4a640 1 -- start start 2024-09-17T04:23:40.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e0155ce0 0x7f14e01f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e01f2dc0 0x7f14e01594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f14e00b5060 con 0x7f14e0074420 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14e00b4ee0 con 0x7f14e0155ce0 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e6d4a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14e00b51e0 con 0x7f14e01f2dc0 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e52e7640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e01f2dc0 0x7f14e01594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e0155ce0 0x7f14e01f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36344/0 (socket says 172.21.15.63:36344) 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 -- 172.21.15.63:0/4181941965 learned_addr learned my addr 172.21.15.63:0/4181941965 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 -- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e01f2dc0 msgr2=0x7f14e01594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e01f2dc0 0x7f14e01594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 -- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e0155ce0 msgr2=0x7f14e01f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e0155ce0 0x7f14e01f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 -- 172.21.15.63:0/4181941965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e01f3f70 con 0x7f14e0074420 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.519+0000 7f14e4ae6640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c3a0 tx=0x7f14dc00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.520+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011790 con 0x7f14e0074420 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.520+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14dc017070 con 0x7f14e0074420 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.520+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e01517a0 con 0x7f14e0074420 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.520+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc011cc0 con 0x7f14e0074420 2024-09-17T04:23:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.520+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e0151f90 con 0x7f14e0074420 2024-09-17T04:23:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.521+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e00b5700 con 0x7f14e0074420 2024-09-17T04:23:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.522+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14dc01c460 con 0x7f14e0074420 2024-09-17T04:23:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.522+0000 7f14d57fa640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 0x7f14cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.522+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f14dc09b350 con 0x7f14e0074420 2024-09-17T04:23:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.522+0000 7f14d7fff640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 0x7f14cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.523+0000 7f14d7fff640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 0x7f14cc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14d0034000 tx=0x7f14d0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:40.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.526+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14dc063900 con 0x7f14e0074420 2024-09-17T04:23:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.747+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14e01f3b40 con 0x7f14e0074420 2024-09-17T04:23:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.748+0000 7f14d57fa640 1 -- 172.21.15.63:0/4181941965 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f14dc063200 con 0x7f14e0074420 2024-09-17T04:23:40.748 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 msgr2=0x7f14cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 0x7f14cc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f14d0034000 tx=0x7f14d0004730 comp rx=0 tx=0).stop 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 msgr2=0x7f14e0151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c3a0 tx=0x7f14dc00c7a0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 shutdown_connections 2024-09-17T04:23:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14cc078b90 0x7f14cc07b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14e0155ce0 0x7f14e01f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14e01f2dc0 0x7f14e01594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 --2- 172.21.15.63:0/4181941965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14e0074420 0x7f14e0151260 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 >> 172.21.15.63:0/4181941965 conn(0x7f14e006def0 msgr2=0x7f14e01526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 shutdown_connections 2024-09-17T04:23:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40.750+0000 7f14e6d4a640 1 -- 172.21.15.63:0/4181941965 wait complete. 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:23:40.761 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:23:40.762 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:23:40.762 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:23:40.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.762 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-17T04:23:40.778 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:40.779 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-17T04:23:40.780 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:40.781 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:23:40.781 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:40.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:40.998 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:23:41.026 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-17T04:23:41.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:41.028 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-17T04:23:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-17T04:23:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:23:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:23:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:23:41.106 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:23:41.106 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:41.107 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:41.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:23:41.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:23:41.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:23:41.107 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:41.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:41.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:41.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:41.419 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:23:41.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:41.435 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-17T04:23:41.492 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:41.492 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:41.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:23:41.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T04:23:41.492 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:41.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:41.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:41.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T04:23:41.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T04:23:41.614 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:41.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:41.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:41.740 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:41.741 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:41.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-17T04:23:41.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:23:41.741 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:41.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:41.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:41.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:41.820 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T04:23:41.835 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:23:41.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:41.836 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:23:41.891 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T04:23:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:41.891 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:23:41.996 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:23:41.997 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:23:41.997 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:42.120 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:23:42.121 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:23:42.121 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:42.121 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:42.121 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:42.127 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:23:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:23:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:42.128 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790" 2024-09-17T04:23:42.129 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2024-09-17T04:23:42.129 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2184e050-2c9d-47fc-8e14-c53eccd8cf79" will pass to kernel 2024-09-17T04:23:42.130 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T04:23:42.130 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:23:42.130 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:23:42.130 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:23:42.130 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:23:42.131 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:23:42.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:42.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:23:42.158 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:42.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:42.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:client4684 2024-09-17T04:23:42.263 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:42.263 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:42.280 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:42.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:42.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:42.385 INFO:teuthology.orchestra.run.smithi063.stdout:client4684 2024-09-17T04:23:42.386 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:42.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:42.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:42.454 INFO:teuthology.orchestra.run.smithi063.stdout:client4684 2024-09-17T04:23:42.454 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2184e050-2c9d-47fc-8e14-c53eccd8cf79.client4684/status') 2024-09-17T04:23:42.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:42.522 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4684 (3)172.21.15.63:0/2815711452 2024-09-17T04:23:42.523 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-17T04:23:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-17T04:23:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-17T04:23:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 2.4593e-05 s, 2.8 MB/s 2024-09-17T04:23:42.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:42.530 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T04:23:42.530 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:23:42.530 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T04:23:42.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:23:42.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.646+0000 7f2af27da640 1 -- 172.21.15.63:0/3431836252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0b4530 msgr2=0x7f2aec15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.646+0000 7f2af27da640 1 --2- 172.21.15.63:0/3431836252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0b4530 0x7f2aec15c830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009830 tx=0x7f2ae002a480 comp rx=0 tx=0).stop 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.646+0000 7f2af27da640 1 -- 172.21.15.63:0/3431836252 shutdown_connections 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.646+0000 7f2af27da640 1 --2- 172.21.15.63:0/3431836252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0b4530 0x7f2aec15c830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.646+0000 7f2af27da640 1 -- 172.21.15.63:0/3431836252 >> 172.21.15.63:0/3431836252 conn(0x7f2aec0cee20 msgr2=0x7f2aec0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.647+0000 7f2af27da640 1 -- 172.21.15.63:0/3431836252 shutdown_connections 2024-09-17T04:23:42.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.647+0000 7f2af27da640 1 -- 172.21.15.63:0/3431836252 wait complete. 2024-09-17T04:23:42.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.648+0000 7f2af27da640 1 Processor -- start 2024-09-17T04:23:42.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.649+0000 7f2af27da640 1 -- start start 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aec160c90 0x7f2aec1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2aec1f2ff0 0x7f2aec1e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0d1900 con 0x7f2aec0cff70 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0d1780 con 0x7f2aec160c90 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af27da640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec0d1a80 con 0x7f2aec1f2ff0 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36354/0 (socket says 172.21.15.63:36354) 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 -- 172.21.15.63:0/1387788281 learned_addr learned my addr 172.21.15.63:0/1387788281 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aeb7fe640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aec160c90 0x7f2aec1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:42.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2af0d77640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2aec1f2ff0 0x7f2aec1e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 -- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2aec1f2ff0 msgr2=0x7f2aec1e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2aec1f2ff0 0x7f2aec1e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 -- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aec160c90 msgr2=0x7f2aec1f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aec160c90 0x7f2aec1f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 -- 172.21.15.63:0/1387788281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec1f6b00 con 0x7f2aec0cff70 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.650+0000 7f2aebfff640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c3a0 tx=0x7f2adc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.651+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc011790 con 0x7f2aec0cff70 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.651+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2adc017070 con 0x7f2aec0cff70 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.651+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec1f6de0 con 0x7f2aec0cff70 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.651+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc011cc0 con 0x7f2aec0cff70 2024-09-17T04:23:42.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.651+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec1f73a0 con 0x7f2aec0cff70 2024-09-17T04:23:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.652+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec15c830 con 0x7f2aec0cff70 2024-09-17T04:23:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.653+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2adc01c460 con 0x7f2aec0cff70 2024-09-17T04:23:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.653+0000 7f2ae8ff9640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 0x7f2ad807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.653+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2adc09b3e0 con 0x7f2aec0cff70 2024-09-17T04:23:42.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.653+0000 7f2aeb7fe640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 0x7f2ad807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:42.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.654+0000 7f2aeb7fe640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 0x7f2ad807b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034000 tx=0x7f2ae0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:42.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.657+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2adc0632b0 con 0x7f2aec0cff70 2024-09-17T04:23:42.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.877+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2aec159f40 con 0x7f2aec0cff70 2024-09-17T04:23:42.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.877+0000 7f2ae8ff9640 1 -- 172.21.15.63:0/1387788281 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f2adc067ce0 con 0x7f2aec0cff70 2024-09-17T04:23:42.877 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:23:42.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 msgr2=0x7f2ad807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:42.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 0x7f2ad807b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0034000 tx=0x7f2ae0004730 comp rx=0 tx=0).stop 2024-09-17T04:23:42.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 msgr2=0x7f2aec0b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:42.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c3a0 tx=0x7f2adc00c860 comp rx=0 tx=0).stop 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 shutdown_connections 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2ad8078b90 0x7f2ad807b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2aec160c90 0x7f2aec1f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2aec1f2ff0 0x7f2aec1e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 --2- 172.21.15.63:0/1387788281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2aec0cff70 0x7f2aec0b6ef0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 >> 172.21.15.63:0/1387788281 conn(0x7f2aec0cee20 msgr2=0x7f2aec0d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 shutdown_connections 2024-09-17T04:23:42.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:42.879+0000 7f2af27da640 1 -- 172.21.15.63:0/1387788281 wait complete. 2024-09-17T04:23:42.890 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:23:42.890 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:23:42.891 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T04:23:42.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:42.891 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:42.908 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42773sec preferred_lft 42773sec 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.909 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 82:89:e1:21:92:f1 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::470:6fff:fe80:2856/64 scope link 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 82:89:e1:21:92:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::8089:e1ff:fe21:92f1/64 scope link tentative 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:42.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:42.910 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:23:42.973 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-17T04:23:42.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:42.974 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-17T04:23:43.031 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-17T04:23:43.031 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:23:43.031 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:23:43.031 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:23:43.031 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:23:43.032 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:43.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:43.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:43.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.161 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:23:43.177 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:23:43.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.177 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-17T04:23:43.232 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T04:23:43.233 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:43.233 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:43.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T04:23:43.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T04:23:43.233 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:43.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:43.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:43.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T04:23:43.379 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:43.379 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:43.379 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:43.379 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.380 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:43.380 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.380 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:43.380 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether a6:97:e7:04:a6:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:23:43.380 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:23:43.381 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.381 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::a497:e7ff:fe04:a657/64 scope link 2024-09-17T04:23:43.381 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether a6:97:e7:04:a6:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:23:43.448 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:23:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::a497:e7ff:fe04:a657/64 scope link 2024-09-17T04:23:43.449 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:43.450 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T04:23:43.451 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:43.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:43.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:43.606 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:43.606 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:23:43.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.1 up 2024-09-17T04:23:43.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T04:23:43.606 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:23:43.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:43.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:43.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:43.685 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T04:23:43.701 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T04:23:43.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:43.701 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T04:23:43.757 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T04:23:43.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T04:23:43.853 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T04:23:43.853 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T04:23:43.853 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:43.864 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T04:23:43.864 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T04:23:43.864 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:43.864 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:43.864 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:43.870 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T04:23:43.870 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T04:23:43.870 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:23:43.870 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:43.870 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790" 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=2184e050-2c9d-47fc-8e14-c53eccd8cf79" will pass to kernel 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:23:43.871 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:23:43.872 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:23:43.873 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:23:43.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:43.873 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T04:23:43.899 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:43.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:43.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:43.997 INFO:teuthology.orchestra.run.smithi063.stdout:client4686 2024-09-17T04:23:43.997 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:43.997 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:44.013 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:44.112 INFO:teuthology.orchestra.run.smithi063.stdout:client4686 2024-09-17T04:23:44.112 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:44.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:44.169 INFO:teuthology.orchestra.run.smithi063.stdout:client4686 2024-09-17T04:23:44.169 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2184e050-2c9d-47fc-8e14-c53eccd8cf79.client4686/status') 2024-09-17T04:23:44.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:44.228 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4686 (3)192.168.0.2:0/1331170794 2024-09-17T04:23:44.229 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-17T04:23:44.229 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-17T04:23:44.229 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-17T04:23:44.229 INFO:teuthology.orchestra.run.smithi063.stderr:69 bytes copied, 2.6931e-05 s, 2.6 MB/s 2024-09-17T04:23:44.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:44.236 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T04:23:44.237 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:23:44.237 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:23:44.237 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 -- 172.21.15.63:0/3699505017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b66f0 msgr2=0x7f34380b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 --2- 172.21.15.63:0/3699505017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b66f0 0x7f34380b60b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3428009820 tx=0x7f342802a510 comp rx=0 tx=0).stop 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 -- 172.21.15.63:0/3699505017 shutdown_connections 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 --2- 172.21.15.63:0/3699505017 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b40f0 0x7f34380cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 --2- 172.21.15.63:0/3699505017 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b66f0 0x7f34380b60b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 -- 172.21.15.63:0/3699505017 >> 172.21.15.63:0/3699505017 conn(0x7f34380d12a0 msgr2=0x7f34380d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 -- 172.21.15.63:0/3699505017 shutdown_connections 2024-09-17T04:23:44.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.354+0000 7f343e6ec640 1 -- 172.21.15.63:0/3699505017 wait complete. 2024-09-17T04:23:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.356+0000 7f343e6ec640 1 Processor -- start 2024-09-17T04:23:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.356+0000 7f343e6ec640 1 -- start start 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 0x7f343815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b66f0 0x7f343815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f343806d4f0 con 0x7f34380ce490 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f34380ceab0 con 0x7f34380b40f0 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343e6ec640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f343806d670 con 0x7f34380b66f0 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343cc89640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f3437fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 0x7f343815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343cc89640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36358/0 (socket says 172.21.15.63:36358) 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f34377fe640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b66f0 0x7f343815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.357+0000 7f343cc89640 1 -- 172.21.15.63:0/2143933957 learned_addr learned my addr 172.21.15.63:0/2143933957 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 -- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b66f0 msgr2=0x7f343815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b66f0 0x7f343815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 -- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 msgr2=0x7f343815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 0x7f343815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 -- 172.21.15.63:0/2143933957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343815c650 con 0x7f34380ce490 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f3437fff640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 0x7f343815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343cc89640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f343000cad0 tx=0x7f343000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430016020 con 0x7f34380ce490 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f343000ad40 con 0x7f34380ce490 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343815c8f0 con 0x7f34380ce490 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430012680 con 0x7f34380ce490 2024-09-17T04:23:44.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.358+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343815ceb0 con 0x7f34380ce490 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.359+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343806db20 con 0x7f34380ce490 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.360+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3430019020 con 0x7f34380ce490 2024-09-17T04:23:44.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.361+0000 7f3434ff9640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:44.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.361+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f343009b190 con 0x7f34380ce490 2024-09-17T04:23:44.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.361+0000 7f3437fff640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:44.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.362+0000 7f3437fff640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 0x7f342407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3428034000 tx=0x7f3428004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:44.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.365+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3430020020 con 0x7f34380ce490 2024-09-17T04:23:44.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.592+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34380b1140 con 0x7f34380ce490 2024-09-17T04:23:44.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.593+0000 7f3434ff9640 1 -- 172.21.15.63:0/2143933957 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3430062f90 con 0x7f34380ce490 2024-09-17T04:23:44.592 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 msgr2=0x7f342407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 0x7f342407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3428034000 tx=0x7f3428004730 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 msgr2=0x7f34380cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f343000cad0 tx=0x7f343000cf90 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 shutdown_connections 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3424078b90 0x7f342407b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34380ce490 0x7f34380cfe80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f34380b66f0 0x7f343815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 --2- 172.21.15.63:0/2143933957 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f34380b40f0 0x7f343815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 >> 172.21.15.63:0/2143933957 conn(0x7f34380d12a0 msgr2=0x7f343815f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 shutdown_connections 2024-09-17T04:23:44.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:44.595+0000 7f343e6ec640 1 -- 172.21.15.63:0/2143933957 wait complete. 2024-09-17T04:23:44.608 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:23:44.608 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:23:44.608 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-17T04:23:44.608 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T04:23:44.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T04:23:44.609 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:23:44.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:23:44.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:23:44.609 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:23:44.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:44.609 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:44.630 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-17T04:23:44.631 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:44.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T04:23:44.632 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:44.632 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:44.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add name ceph-brx type bridge 2024-09-17T04:23:44.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr flush dev ceph-brx 2024-09-17T04:23:44.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set ceph-brx up 2024-09-17T04:23:44.633 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T04:23:44.633 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:44.725 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:44.932 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:44.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:44.939 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:23:44.963 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-17T04:23:44.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:44.965 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-17T04:23:45.031 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-17T04:23:45.031 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:23:45.031 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:23:45.031 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:23:45.031 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:23:45.032 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:45.119 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:45.363 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:45.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:45.369 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:23:45.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:45.385 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-17T04:23:45.440 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:45.441 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:45.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:23:45.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T04:23:45.441 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:45.529 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:45.554 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:45.560 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T04:23:45.561 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:45.610 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:45.693 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:45.699 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:45.699 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:45.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.0 up 2024-09-17T04:23:45.700 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T04:23:45.700 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:45.747 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:45.769 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:45.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:45.775 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T04:23:45.790 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T04:23:45.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:45.790 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:23:45.847 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T04:23:45.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:45.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T04:23:45.953 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T04:23:45.953 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T04:23:45.953 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:46.079 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T04:23:46.079 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T04:23:46.079 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:46.079 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:46.079 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790" 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2024-09-17T04:23:46.087 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2184e050-2c9d-47fc-8e14-c53eccd8cf79" will pass to kernel 2024-09-17T04:23:46.088 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T04:23:46.088 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:23:46.088 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:23:46.088 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:23:46.088 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:23:46.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:23:46.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:46.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T04:23:46.114 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:46.203 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:46.204 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:46.210 INFO:teuthology.orchestra.run.smithi112.stdout:client4699 2024-09-17T04:23:46.210 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:46.210 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:46.226 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:46.313 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:46.314 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:46.320 INFO:teuthology.orchestra.run.smithi112.stdout:client4699 2024-09-17T04:23:46.321 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:46.369 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:46.371 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:46.377 INFO:teuthology.orchestra.run.smithi112.stdout:client4699 2024-09-17T04:23:46.377 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2184e050-2c9d-47fc-8e14-c53eccd8cf79.client4699/status') 2024-09-17T04:23:46.426 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:46.436 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4699 (3)192.168.0.1:0/3789924810 2024-09-17T04:23:46.437 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-17T04:23:46.437 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-17T04:23:46.437 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-17T04:23:46.437 INFO:teuthology.orchestra.run.smithi112.stderr:69 bytes copied, 2.1302e-05 s, 3.2 MB/s 2024-09-17T04:23:46.437 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:46.444 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T04:23:46.444 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T04:23:46.444 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T04:23:46.444 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 -- 172.21.15.63:0/1222193727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 msgr2=0x7ff2140b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 --2- 172.21.15.63:0/1222193727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2140b5fa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009830 tx=0x7ff1fc02a380 comp rx=0 tx=0).stop 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 -- 172.21.15.63:0/1222193727 shutdown_connections 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 --2- 172.21.15.63:0/1222193727 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2140b5fa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 --2- 172.21.15.63:0/1222193727 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b9b60 0x7ff2140d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 -- 172.21.15.63:0/1222193727 >> 172.21.15.63:0/1222193727 conn(0x7ff21409d7f0 msgr2=0x7ff2140d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 -- 172.21.15.63:0/1222193727 shutdown_connections 2024-09-17T04:23:46.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.576+0000 7ff219e9b640 1 -- 172.21.15.63:0/1222193727 wait complete. 2024-09-17T04:23:46.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.578+0000 7ff219e9b640 1 Processor -- start 2024-09-17T04:23:46.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.579+0000 7ff219e9b640 1 -- start start 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b64e0 0x7ff21415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2141f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140d2cc0 con 0x7ff2140b9b60 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff21406fdb0 con 0x7ff2140cf540 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff219e9b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140d2e40 con 0x7ff2140b64e0 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36366/0 (socket says 172.21.15.63:36366) 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 -- 172.21.15.63:0/2783372832 learned_addr learned my addr 172.21.15.63:0/2783372832 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:46.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff2137fe640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b64e0 0x7ff21415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff213fff640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2141f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 -- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b64e0 msgr2=0x7ff21415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b64e0 0x7ff21415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 -- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 msgr2=0x7ff2141f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2141f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.580+0000 7ff20affd640 1 -- 172.21.15.63:0/2783372832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2141f9c80 con 0x7ff2140b9b60 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff20affd640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009950 tx=0x7ff1fc003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc03f030 con 0x7ff2140b9b60 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1fc004510 con 0x7ff2140b9b60 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2140cd610 con 0x7ff2140b9b60 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc037040 con 0x7ff2140b9b60 2024-09-17T04:23:46.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.581+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2140cdbd0 con 0x7ff2140b9b60 2024-09-17T04:23:46.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.582+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2140d3350 con 0x7ff2140b9b60 2024-09-17T04:23:46.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.583+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1fc042070 con 0x7ff2140b9b60 2024-09-17T04:23:46.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.583+0000 7ff210ff9640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:46.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.583+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1fc0ba800 con 0x7ff2140b9b60 2024-09-17T04:23:46.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.583+0000 7ff2137fe640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:46.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.584+0000 7ff2137fe640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff204009590 tx=0x7ff204005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:46.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.588+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1fc049070 con 0x7ff2140b9b60 2024-09-17T04:23:46.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.810+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff2140cd3a0 con 0x7ff2140b9b60 2024-09-17T04:23:46.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.810+0000 7ff210ff9640 1 -- 172.21.15.63:0/2783372832 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7ff1fc082680 con 0x7ff2140b9b60 2024-09-17T04:23:46.810 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 msgr2=0x7ff1f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff204009590 tx=0x7ff204005f30 comp rx=0 tx=0).stop 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 msgr2=0x7ff2140ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009950 tx=0x7ff1fc003b60 comp rx=0 tx=0).stop 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 shutdown_connections 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff1f4078bc0 0x7ff1f407b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff2140cf540 0x7ff2141f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140b9b60 0x7ff2140ccaa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 --2- 172.21.15.63:0/2783372832 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff2140b64e0 0x7ff21415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:46.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 >> 172.21.15.63:0/2783372832 conn(0x7ff21409d7f0 msgr2=0x7ff2140b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:46.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 shutdown_connections 2024-09-17T04:23:46.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:46.812+0000 7ff219e9b640 1 -- 172.21.15.63:0/2783372832 wait complete. 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi112.front.sepia.ceph.com 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T04:23:46.823 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T04:23:46.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T04:23:46.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:23:46.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T04:23:46.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:46.824 DEBUG:teuthology.orchestra.run.smithi112:> ip addr 2024-09-17T04:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2c brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f0 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:d8:a5:2d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: altname enp7s0f1 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:68 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 0c:c4:7a:8f:cb:69 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: inet 172.21.15.112/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft 42767sec preferred_lft 42767sec 2024-09-17T04:23:46.841 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::ec4:7aff:fe8f:cb69/64 scope link noprefixroute 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether f2:99:b4:50:c2:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::4467:caff:fee6:b0fb/64 scope link 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether f2:99:b4:50:c2:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:23:46.842 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::f099:b4ff:fe50:c21d/64 scope link tentative 2024-09-17T04:23:46.843 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:46.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:46.843 DEBUG:teuthology.orchestra.run.smithi112:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:23:46.905 INFO:teuthology.orchestra.run.smithi112.stdout:1 2024-09-17T04:23:46.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:46.906 DEBUG:teuthology.orchestra.run.smithi112:> route 2024-09-17T04:23:46.963 INFO:teuthology.orchestra.run.smithi112.stdout:Kernel IP routing table 2024-09-17T04:23:46.964 INFO:teuthology.orchestra.run.smithi112.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:23:46.964 INFO:teuthology.orchestra.run.smithi112.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:23:46.964 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:23:46.964 INFO:teuthology.orchestra.run.smithi112.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:23:46.964 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:46.964 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:46.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:23:46.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:23:46.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:23:46.965 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:47.051 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:47.084 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:47.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.090 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:23:47.106 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T04:23:47.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.106 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list-id 2024-09-17T04:23:47.161 INFO:teuthology.orchestra.run.smithi112.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T04:23:47.161 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:47.161 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:47.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T04:23:47.161 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T04:23:47.161 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:47.248 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:47.271 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:47.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2a:51:80:90:6c:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:23:47.302 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.303 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2851:80ff:fe90:6c9f/64 scope link tentative 2024-09-17T04:23:47.303 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 ::1/128 scope host 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: link/ether 2a:51:80:90:6c:9f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T04:23:47.368 INFO:teuthology.orchestra.run.smithi112.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T04:23:47.369 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.369 INFO:teuthology.orchestra.run.smithi112.stdout: inet6 fe80::2851:80ff:fe90:6c9f/64 scope link tentative 2024-09-17T04:23:47.369 INFO:teuthology.orchestra.run.smithi112.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:23:47.370 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T04:23:47.370 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:47.458 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:47.517 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:47.523 DEBUG:teuthology.orchestra.run.smithi112:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:23:47.523 DEBUG:teuthology.orchestra.run.smithi112:> set -e 2024-09-17T04:23:47.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set brx.1 up 2024-09-17T04:23:47.523 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T04:23:47.524 DEBUG:teuthology.orchestra.run.smithi112:> ') 2024-09-17T04:23:47.571 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:47.594 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:47.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:47.601 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T04:23:47.616 INFO:teuthology.orchestra.run.smithi112.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T04:23:47.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:23:47.616 DEBUG:teuthology.orchestra.run.smithi112:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T04:23:47.671 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T04:23:47.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.671 DEBUG:teuthology.orchestra.run.smithi112:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T04:23:47.765 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T04:23:47.765 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T04:23:47.765 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:47.775 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T04:23:47.775 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T04:23:47.775 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:47.776 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:47.776 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:invalid new device string format 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:23:47.785 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790" 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=2184e050-2c9d-47fc-8e14-c53eccd8cf79" will pass to kernel 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:23:47.786 INFO:teuthology.orchestra.run.smithi112.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:23:47.788 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:23:47.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:47.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T04:23:47.812 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:47.901 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:47.903 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:47.908 INFO:teuthology.orchestra.run.smithi112.stdout:client4698 2024-09-17T04:23:47.909 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:47.909 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:47.925 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:48.012 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:48.013 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:48.019 INFO:teuthology.orchestra.run.smithi112.stdout:client4698 2024-09-17T04:23:48.019 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:23:48.067 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:23:48.069 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:48.074 INFO:teuthology.orchestra.run.smithi112.stdout:client4698 2024-09-17T04:23:48.075 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2184e050-2c9d-47fc-8e14-c53eccd8cf79.client4698/status') 2024-09-17T04:23:48.122 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:23:48.132 INFO:teuthology.orchestra.run.smithi112.stdout:instance: client.4698 (3)172.21.15.112:0/3894270325 2024-09-17T04:23:48.132 INFO:teuthology.orchestra.run.smithi112.stdout:blocklisted: false 2024-09-17T04:23:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records in 2024-09-17T04:23:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:0+1 records out 2024-09-17T04:23:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:71 bytes copied, 2.1554e-05 s, 3.3 MB/s 2024-09-17T04:23:48.133 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-17T04:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:23:48.139 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T04:23:48.177 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-09-17T04:23:48.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:48.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 -- 172.21.15.63:0/3912589916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040d1d40 msgr2=0x7fca040b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 --2- 172.21.15.63:0/3912589916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040d1d40 0x7fca040b5210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca04074550 tx=0x7fc9f402a530 comp rx=0 tx=0).stop 2024-09-17T04:23:48.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 -- 172.21.15.63:0/3912589916 shutdown_connections 2024-09-17T04:23:48.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 --2- 172.21.15.63:0/3912589916 >> v2:172.21.15.112:3300/0 conn(0x7fca0415c6f0 0x7fca040ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 --2- 172.21.15.63:0/3912589916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040d1d40 0x7fca040b5210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 -- 172.21.15.63:0/3912589916 >> 172.21.15.63:0/3912589916 conn(0x7fca040b3f10 msgr2=0x7fca040b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:48.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 -- 172.21.15.63:0/3912589916 shutdown_connections 2024-09-17T04:23:48.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.309+0000 7fca0a07e640 1 -- 172.21.15.63:0/3912589916 wait complete. 2024-09-17T04:23:48.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.311+0000 7fca0a07e640 1 Processor -- start 2024-09-17T04:23:48.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.311+0000 7fca0a07e640 1 -- start start 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca040d1d40 0x7fca04155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0415c6f0 0x7fca04156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca040d11f0 con 0x7fca040ccba0 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fca040d1070 con 0x7fca0415c6f0 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca0a07e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fca040d1370 con 0x7fca040d1d40 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36390/0 (socket says 172.21.15.63:36390) 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 -- 172.21.15.63:0/1781127288 learned_addr learned my addr 172.21.15.63:0/1781127288 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca03fff640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0415c6f0 0x7fca04156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca02ffd640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca040d1d40 0x7fca04155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 -- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca040d1d40 msgr2=0x7fca04155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca040d1d40 0x7fca04155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 -- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0415c6f0 msgr2=0x7fca04156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0415c6f0 0x7fca04156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 -- 172.21.15.63:0/1781127288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca04158fd0 con 0x7fca040ccba0 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fca037fe640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009920 tx=0x7fc9f4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.313+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4031d60 con 0x7fca040ccba0 2024-09-17T04:23:48.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.314+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9f4033e10 con 0x7fca040ccba0 2024-09-17T04:23:48.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.314+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca040c9460 con 0x7fca040ccba0 2024-09-17T04:23:48.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.314+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4005260 con 0x7fca040ccba0 2024-09-17T04:23:48.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.314+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca040c9a20 con 0x7fca040ccba0 2024-09-17T04:23:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.315+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca040d1870 con 0x7fca040ccba0 2024-09-17T04:23:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.315+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9f4005400 con 0x7fca040ccba0 2024-09-17T04:23:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.316+0000 7fc9ebfff640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.316+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9f40bbe20 con 0x7fca040ccba0 2024-09-17T04:23:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.316+0000 7fca02ffd640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.316+0000 7fca02ffd640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 0x7fc9f007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca040ccb40 tx=0x7fc9f8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.320+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9f403f030 con 0x7fca040ccba0 2024-09-17T04:23:48.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.507+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca041594a0 con 0x7fca040ccba0 2024-09-17T04:23:48.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.508+0000 7fc9ebfff640 1 -- 172.21.15.63:0/1781127288 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7fc9f4083c10 con 0x7fca040ccba0 2024-09-17T04:23:48.508 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:48.509 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:48.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 msgr2=0x7fc9f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 0x7fc9f007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca040ccb40 tx=0x7fc9f8005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:48.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 msgr2=0x7fca040ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009920 tx=0x7fc9f4033c20 comp rx=0 tx=0).stop 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 shutdown_connections 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fca0415c6f0 0x7fca04156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fca040d1d40 0x7fca04155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 --2- 172.21.15.63:0/1781127288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca040ccba0 0x7fca040ca500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.510+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 >> 172.21.15.63:0/1781127288 conn(0x7fca040b3f10 msgr2=0x7fca0415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.511+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 shutdown_connections 2024-09-17T04:23:48.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.511+0000 7fca0a07e640 1 -- 172.21.15.63:0/1781127288 wait complete. 2024-09-17T04:23:48.522 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T04:23:12.414663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T04:23:22.622503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T04:23:23.678624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T04:23:48.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T04:23:48.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 -- 172.21.15.63:0/292857378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 msgr2=0x7f3f54005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/292857378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f54005190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0ceba0 tx=0x7f3f54005830 comp rx=0 tx=0).stop 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f71441640 1 -- 172.21.15.63:0/292857378 reap_dead start 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 -- 172.21.15.63:0/292857378 shutdown_connections 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 -- 172.21.15.63:0/292857378 >> 172.21.15.63:0/292857378 conn(0x7f3f6c09d8f0 msgr2=0x7f3f6c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 -- 172.21.15.63:0/292857378 shutdown_connections 2024-09-17T04:23:48.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.643+0000 7f3f72ea4640 1 -- 172.21.15.63:0/292857378 wait complete. 2024-09-17T04:23:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.645+0000 7f3f72ea4640 1 Processor -- start 2024-09-17T04:23:48.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.645+0000 7f3f72ea4640 1 -- start start 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 0x7f3f6c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 0x7f3f6c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c0cfdb0 con 0x7f3f54004d40 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c0cfc30 con 0x7f3f6c06f650 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f72ea4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3f6c0cff30 con 0x7f3f6c14f520 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36420/0 (socket says 172.21.15.63:36420) 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 -- 172.21.15.63:0/2039405074 learned_addr learned my addr 172.21.15.63:0/2039405074 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f6bfff640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 0x7f3f6c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f71441640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 0x7f3f6c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 -- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 msgr2=0x7f3f6c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 0x7f3f6c06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 -- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 msgr2=0x7f3f6c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 0x7f3f6c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 -- 172.21.15.63:0/2039405074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c06fa60 con 0x7f3f54004d40 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f6bfff640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 0x7f3f6c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f71441640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 0x7f3f6c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f70c40640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c001480 tx=0x7f3f5c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.647+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c015070 con 0x7f3f54004d40 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.648+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f5c011860 con 0x7f3f54004d40 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.648+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c011cb0 con 0x7f3f54004d40 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.648+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c1f8e40 con 0x7f3f54004d40 2024-09-17T04:23:48.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.648+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c1f9400 con 0x7f3f54004d40 2024-09-17T04:23:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.649+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c0cf310 con 0x7f3f54004d40 2024-09-17T04:23:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.650+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f5c018070 con 0x7f3f54004d40 2024-09-17T04:23:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.650+0000 7f3f697fa640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 0x7f3f5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.650+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f5c09b9c0 con 0x7f3f54004d40 2024-09-17T04:23:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.651+0000 7f3f6bfff640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 0x7f3f5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.651+0000 7f3f6bfff640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 0x7f3f5807b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c070050 tx=0x7f3f60006060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.655+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f5c09de20 con 0x7f3f54004d40 2024-09-17T04:23:48.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.839+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3f6c0ba0d0 con 0x7f3f54004d40 2024-09-17T04:23:48.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.839+0000 7f3f697fa640 1 -- 172.21.15.63:0/2039405074 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f3f6c06fa60 con 0x7f3f54004d40 2024-09-17T04:23:48.839 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 msgr2=0x7f3f5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 0x7f3f5807b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c070050 tx=0x7f3f60006060 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 msgr2=0x7f3f6c1f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c001480 tx=0x7f3f5c0039c0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 shutdown_connections 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3f58078bc0 0x7f3f5807b0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3f6c06f650 0x7f3f6c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3f6c14f520 0x7f3f6c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 --2- 172.21.15.63:0/2039405074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f54004d40 0x7f3f6c1f4ad0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 >> 172.21.15.63:0/2039405074 conn(0x7f3f6c09d8f0 msgr2=0x7f3f6c0b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 shutdown_connections 2024-09-17T04:23:48.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.842+0000 7f3f72ea4640 1 -- 172.21.15.63:0/2039405074 wait complete. 2024-09-17T04:23:48.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.972+0000 7f7d2edb0640 1 -- 172.21.15.63:0/1720595820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 msgr2=0x7f7d2806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.972+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/1720595820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d2806f7a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009830 tx=0x7f7d1802a510 comp rx=0 tx=0).stop 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.972+0000 7f7d2edb0640 1 -- 172.21.15.63:0/1720595820 shutdown_connections 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.972+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/1720595820 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d2806f7a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.972+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/1720595820 >> v2:172.21.15.63:3300/0 conn(0x7f7d280b3a60 0x7f7d280cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.973+0000 7f7d2edb0640 1 -- 172.21.15.63:0/1720595820 >> 172.21.15.63:0/1720595820 conn(0x7f7d2808bfc0 msgr2=0x7f7d2809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.973+0000 7f7d2edb0640 1 -- 172.21.15.63:0/1720595820 shutdown_connections 2024-09-17T04:23:48.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.973+0000 7f7d2edb0640 1 -- 172.21.15.63:0/1720595820 wait complete. 2024-09-17T04:23:48.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.974+0000 7f7d2edb0640 1 Processor -- start 2024-09-17T04:23:48.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.974+0000 7f7d2edb0640 1 -- start start 2024-09-17T04:23:48.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d280c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d280b3a60 0x7f7d2815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7d280d2d20 con 0x7f7d280d0e10 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d280d2ba0 con 0x7f7d280b3a60 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2edb0640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7d280d2ea0 con 0x7f7d2806e3c0 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2cb4c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d280c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36448/0 (socket says 172.21.15.63:36448) 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 -- 172.21.15.63:0/3016990037 learned_addr learned my addr 172.21.15.63:0/3016990037 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d1ffff640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d280b3a60 0x7f7d2815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 -- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 msgr2=0x7f7d280c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d280c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 -- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d280b3a60 msgr2=0x7f7d2815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d280b3a60 0x7f7d2815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 -- 172.21.15.63:0/3016990037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d280ca390 con 0x7f7d280d0e10 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.976+0000 7f7d2d34d640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d20002230 tx=0x7f7d2000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.977+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003b70 con 0x7f7d280d0e10 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.977+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d20003d10 con 0x7f7d280d0e10 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.977+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d280ca8a0 con 0x7f7d280d0e10 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.977+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20005330 con 0x7f7d280d0e10 2024-09-17T04:23:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.977+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d281f9600 con 0x7f7d280d0e10 2024-09-17T04:23:48.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.978+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d280b3430 con 0x7f7d280d0e10 2024-09-17T04:23:48.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.979+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d200054d0 con 0x7f7d280d0e10 2024-09-17T04:23:48.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.979+0000 7f7d1d7fa640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 0x7f7d1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.979+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d2009aa00 con 0x7f7d280d0e10 2024-09-17T04:23:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.979+0000 7f7d2cb4c640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 0x7f7d1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.980+0000 7f7d2cb4c640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 0x7f7d1407b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009530 tx=0x7f7d24009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:48.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:48.984+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d280b3430 con 0x7f7d280d0e10 2024-09-17T04:23:49.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.168+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7d280ca630 con 0x7f7d280d0e10 2024-09-17T04:23:49.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.169+0000 7f7d1d7fa640 1 -- 172.21.15.63:0/3016990037 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f7d2806fce0 con 0x7f7d280d0e10 2024-09-17T04:23:49.169 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 msgr2=0x7f7d1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 0x7f7d1407b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009530 tx=0x7f7d24009260 comp rx=0 tx=0).stop 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 msgr2=0x7f7d280b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d20002230 tx=0x7f7d2000cb90 comp rx=0 tx=0).stop 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 shutdown_connections 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d14078b90 0x7f7d1407b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d280b3a60 0x7f7d2815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d280d0e10 0x7f7d280b6390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 --2- 172.21.15.63:0/3016990037 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d2806e3c0 0x7f7d280c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 >> 172.21.15.63:0/3016990037 conn(0x7f7d2808bfc0 msgr2=0x7f7d280d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 shutdown_connections 2024-09-17T04:23:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.171+0000 7f7d2edb0640 1 -- 172.21.15.63:0/3016990037 wait complete. 2024-09-17T04:23:49.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T04:23:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 -- 172.21.15.63:0/3156206658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0ced80 msgr2=0x7f591c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 --2- 172.21.15.63:0/3156206658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0ced80 0x7f591c0cf190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f591c1604c0 tx=0x7f590c02a560 comp rx=0 tx=0).stop 2024-09-17T04:23:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 -- 172.21.15.63:0/3156206658 shutdown_connections 2024-09-17T04:23:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 --2- 172.21.15.63:0/3156206658 >> v2:172.21.15.112:3300/0 conn(0x7f591c0b3e10 0x7f591c0b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 --2- 172.21.15.63:0/3156206658 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0d0280 0x7f591c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 --2- 172.21.15.63:0/3156206658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0ced80 0x7f591c0cf190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 -- 172.21.15.63:0/3156206658 >> 172.21.15.63:0/3156206658 conn(0x7f591c06d520 msgr2=0x7f591c071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 -- 172.21.15.63:0/3156206658 shutdown_connections 2024-09-17T04:23:49.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.301+0000 7f59212f9640 1 -- 172.21.15.63:0/3156206658 wait complete. 2024-09-17T04:23:49.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.303+0000 7f59212f9640 1 Processor -- start 2024-09-17T04:23:49.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.303+0000 7f59212f9640 1 -- start start 2024-09-17T04:23:49.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0ced80 0x7f591c1f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c0d0280 0x7f591c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f591c0b4760 con 0x7f591c0b3e10 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f591c15ce70 con 0x7f591c0d0280 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.304+0000 7f59212f9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f591c0b48e0 con 0x7f591c0ced80 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36464/0 (socket says 172.21.15.63:36464) 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 -- 172.21.15.63:0/3061911965 learned_addr learned my addr 172.21.15.63:0/3061911965 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591b7fe640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c0d0280 0x7f591c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591a7fc640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0ced80 0x7f591c1f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 -- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0ced80 msgr2=0x7f591c1f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0ced80 0x7f591c1f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 -- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c0d0280 msgr2=0x7f591c150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c0d0280 0x7f591c150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 -- 172.21.15.63:0/3061911965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c1f5ec0 con 0x7f591c0b3e10 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f591affd640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f590c034040 tx=0x7f590c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c03e030 con 0x7f591c0b3e10 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c1f61a0 con 0x7f591c0b3e10 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f590c003ca0 con 0x7f591c0b3e10 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c035040 con 0x7f591c0b3e10 2024-09-17T04:23:49.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.305+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c1f6760 con 0x7f591c0b3e10 2024-09-17T04:23:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.306+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591c0cf190 con 0x7f591c0b3e10 2024-09-17T04:23:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.307+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f590c041030 con 0x7f591c0b3e10 2024-09-17T04:23:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.308+0000 7f59137fe640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 0x7f58fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.308+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f590c0bb370 con 0x7f591c0b3e10 2024-09-17T04:23:49.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.308+0000 7f591a7fc640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 0x7f58fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.309+0000 7f591a7fc640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 0x7f58fc07b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b1c30 tx=0x7f5904005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:49.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.313+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f590c0830e0 con 0x7f591c0b3e10 2024-09-17T04:23:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.501+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f591c15b5d0 con 0x7f591c0b3e10 2024-09-17T04:23:49.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.502+0000 7f59137fe640 1 -- 172.21.15.63:0/3061911965 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f590c087b10 con 0x7f591c0b3e10 2024-09-17T04:23:49.501 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 msgr2=0x7f58fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 0x7f58fc07b0d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b1c30 tx=0x7f5904005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 msgr2=0x7f591c0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f590c034040 tx=0x7f590c0038a0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 shutdown_connections 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f58fc078bc0 0x7f58fc07b0d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f591c0d0280 0x7f591c150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f591c0ced80 0x7f591c1f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 --2- 172.21.15.63:0/3061911965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f591c0b3e10 0x7f591c0cbdc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 >> 172.21.15.63:0/3061911965 conn(0x7f591c06d520 msgr2=0x7f591c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:49.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 shutdown_connections 2024-09-17T04:23:49.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.504+0000 7f59212f9640 1 -- 172.21.15.63:0/3061911965 wait complete. 2024-09-17T04:23:49.515 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 -- 172.21.15.63:0/2181479147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 msgr2=0x7f496c0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 --2- 172.21.15.63:0/2181479147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c0d1260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f496c0d1950 tx=0x7f496402a420 comp rx=0 tx=0).stop 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 -- 172.21.15.63:0/2181479147 shutdown_connections 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 --2- 172.21.15.63:0/2181479147 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c0d1260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 --2- 172.21.15.63:0/2181479147 >> v2:172.21.15.112:3300/0 conn(0x7f496c06f6e0 0x7f496c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 --2- 172.21.15.63:0/2181479147 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06e0a0 0x7f496c0b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 -- 172.21.15.63:0/2181479147 >> 172.21.15.63:0/2181479147 conn(0x7f496c09d840 msgr2=0x7f496c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 -- 172.21.15.63:0/2181479147 shutdown_connections 2024-09-17T04:23:49.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.632+0000 7f4971041640 1 -- 172.21.15.63:0/2181479147 wait complete. 2024-09-17T04:23:49.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.634+0000 7f4971041640 1 Processor -- start 2024-09-17T04:23:49.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.634+0000 7f4971041640 1 -- start start 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f496c06e0a0 0x7f496c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06f6e0 0x7f496c1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f496c0cfc90 con 0x7f496c0d0e50 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f496c0cfb10 con 0x7f496c06e0a0 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f4971041640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f496c0cfe10 con 0x7f496c06f6e0 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f496b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f496b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36482/0 (socket says 172.21.15.63:36482) 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f496b59e640 1 -- 172.21.15.63:0/2570643839 learned_addr learned my addr 172.21.15.63:0/2570643839 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f496ad9d640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f496c06e0a0 0x7f496c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.635+0000 7f496a59c640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06f6e0 0x7f496c1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 -- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06f6e0 msgr2=0x7f496c1f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06f6e0 0x7f496c1f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 -- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f496c06e0a0 msgr2=0x7f496c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f496c06e0a0 0x7f496c0ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 -- 172.21.15.63:0/2570643839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496c1f6370 con 0x7f496c0d0e50 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f496b59e640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4964034040 tx=0x7f4964003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496403e030 con 0x7f496c0d0e50 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4964003e50 con 0x7f496c0d0e50 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964035040 con 0x7f496c0d0e50 2024-09-17T04:23:49.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496c0b5130 con 0x7f496c0d0e50 2024-09-17T04:23:49.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.636+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496c151680 con 0x7f496c0d0e50 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.637+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f496c0b2d80 con 0x7f496c0d0e50 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.638+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4964041030 con 0x7f496c0d0e50 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.639+0000 7f49537fe640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 0x7f495807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.639+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f49640bb4e0 con 0x7f496c0d0e50 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.639+0000 7f496ad9d640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 0x7f495807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:49.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.639+0000 7f496ad9d640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 0x7f495807b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f495c00a400 tx=0x7f495c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:49.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.643+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49640832e0 con 0x7f496c0d0e50 2024-09-17T04:23:49.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:49.902+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f496c1f6100 con 0x7f496c0d0e50 2024-09-17T04:23:50.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.451+0000 7f49537fe640 1 -- 172.21.15.63:0/2570643839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v44) ==== 123+0+0 (secure 0 0 0) 0x7f4964087d10 con 0x7f496c0d0e50 2024-09-17T04:23:50.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 msgr2=0x7f495807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 0x7f495807b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f495c00a400 tx=0x7f495c00d040 comp rx=0 tx=0).stop 2024-09-17T04:23:50.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 msgr2=0x7f496c1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4964034040 tx=0x7f4964003960 comp rx=0 tx=0).stop 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 shutdown_connections 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4958078bc0 0x7f495807b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f496c0d0e50 0x7f496c1f5b60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f496c06f6e0 0x7f496c1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 --2- 172.21.15.63:0/2570643839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f496c06e0a0 0x7f496c0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 >> 172.21.15.63:0/2570643839 conn(0x7f496c09d840 msgr2=0x7f496c0ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 shutdown_connections 2024-09-17T04:23:50.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.454+0000 7f4971041640 1 -- 172.21.15.63:0/2570643839 wait complete. 2024-09-17T04:23:50.467 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/62779458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 msgr2=0x7fa6ac0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/62779458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac0b3b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009830 tx=0x7fa69c02a480 comp rx=0 tx=0).stop 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/62779458 shutdown_connections 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/62779458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac0b3b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/62779458 >> 172.21.15.63:0/62779458 conn(0x7fa6ac09d6a0 msgr2=0x7fa6ac0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:50.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/62779458 shutdown_connections 2024-09-17T04:23:50.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.587+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/62779458 wait complete. 2024-09-17T04:23:50.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.589+0000 7fa6b2b9d640 1 Processor -- start 2024-09-17T04:23:50.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.589+0000 7fa6b2b9d640 1 -- start start 2024-09-17T04:23:50.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac162470 0x7fa6ac157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac163110 0x7fa6ac1f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cff70 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0cfdf0 con 0x7fa6ac163110 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b2b9d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0d00f0 con 0x7fa6ac162470 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b1b9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b1b9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40782/0 (socket says 172.21.15.63:40782) 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.590+0000 7fa6b1b9b640 1 -- 172.21.15.63:0/167737612 learned_addr learned my addr 172.21.15.63:0/167737612 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b239c640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac163110 0x7fa6ac1f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b139a640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac162470 0x7fa6ac157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 -- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac162470 msgr2=0x7fa6ac157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac162470 0x7fa6ac157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 -- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac163110 msgr2=0x7fa6ac1f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac163110 0x7fa6ac1f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 -- 172.21.15.63:0/167737612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac1f6630 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b1b9b640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c730 tx=0x7fa6a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8017070 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6a800ce40 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac157d70 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8005330 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.591+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac1f6350 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.592+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac0b3b50 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.593+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6a801a070 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.594+0000 7fa6a27fc640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 0x7fa69007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.594+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a809a340 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.594+0000 7fa6b139a640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 0x7fa69007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.595+0000 7fa6b139a640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 0x7fa69007b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa69c034000 tx=0x7fa69c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:50.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.598+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6a8062250 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.781+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa6ac08e450 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.781+0000 7fa6a27fc640 1 -- 172.21.15.63:0/167737612 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7fa6a8066c80 con 0x7fa6ac0b5a20 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced client_mount_timeout 30 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_client 20/20 2024-09-17T04:23:50.781 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_mgr 20/20 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_ms 1/1 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4822.593930 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 7095.483757 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4837.180489 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4408.520586 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5077.176648 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 7580.139279 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5367.221819 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5301.039523 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds 20/20 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_ms 2/2 2024-09-17T04:23:50.782 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_frag true 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_scatterstat true 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_verify_scatter true 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced client_mount_timeout 600 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_client 20/20 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_ms 1/1 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T04:23:50.783 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T04:23:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 msgr2=0x7fa69007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 0x7fa69007b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa69c034000 tx=0x7fa69c004730 comp rx=0 tx=0).stop 2024-09-17T04:23:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 msgr2=0x7fa6ac1f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c730 tx=0x7fa6a800cbf0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 shutdown_connections 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa690078b90 0x7fa69007b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6ac163110 0x7fa6ac1f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6ac162470 0x7fa6ac157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 --2- 172.21.15.63:0/167737612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6ac0b5a20 0x7fa6ac1f5730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 >> 172.21.15.63:0/167737612 conn(0x7fa6ac09d6a0 msgr2=0x7fa6ac06e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 shutdown_connections 2024-09-17T04:23:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.783+0000 7fa6b2b9d640 1 -- 172.21.15.63:0/167737612 wait complete. 2024-09-17T04:23:50.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T04:23:50.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 -- 172.21.15.63:0/937599806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3298004800 msgr2=0x7f3298004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 --2- 172.21.15.63:0/937599806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3298004800 0x7f3298004c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32b008d9b0 tx=0x7f3298005830 comp rx=0 tx=0).stop 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b4b4a640 1 -- 172.21.15.63:0/937599806 reap_dead start 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 -- 172.21.15.63:0/937599806 shutdown_connections 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 -- 172.21.15.63:0/937599806 >> 172.21.15.63:0/937599806 conn(0x7f32b008bfc0 msgr2=0x7f32b009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 -- 172.21.15.63:0/937599806 shutdown_connections 2024-09-17T04:23:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.915+0000 7f32b65ad640 1 -- 172.21.15.63:0/937599806 wait complete. 2024-09-17T04:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.917+0000 7f32b65ad640 1 Processor -- start 2024-09-17T04:23:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.917+0000 7f32b65ad640 1 -- start start 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3298004800 0x7f32b01f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32b01519e0 0x7f32b01f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f32b006e2f0 con 0x7f32b00cdb50 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f32b006e170 con 0x7f3298004800 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b65ad640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00b3540 con 0x7f32b01519e0 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40802/0 (socket says 172.21.15.63:40802) 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 -- 172.21.15.63:0/4132093846 learned_addr learned my addr 172.21.15.63:0/4132093846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32affff640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3298004800 0x7f32b01f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32b4b4a640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32b01519e0 0x7f32b01f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 -- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32b01519e0 msgr2=0x7f32b01f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32b01519e0 0x7f32b01f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 -- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3298004800 msgr2=0x7f32b01f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3298004800 0x7f32b01f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 -- 172.21.15.63:0/4132093846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0151df0 con 0x7f32b00cdb50 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.919+0000 7f32af7fe640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32b00ba1b0 tx=0x7f32a4006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.920+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4032030 con 0x7f32b00cdb50 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.920+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32a40037f0 con 0x7f32b00cdb50 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.920+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b00cc610 con 0x7f32b00cdb50 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.920+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4003c20 con 0x7f32b00cdb50 2024-09-17T04:23:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.920+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b00ccd90 con 0x7f32b00cdb50 2024-09-17T04:23:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.921+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b006a7e0 con 0x7f32b00cdb50 2024-09-17T04:23:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.922+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32a4035020 con 0x7f32b00cdb50 2024-09-17T04:23:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.922+0000 7f32acff9640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.922+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f32a40bb1c0 con 0x7f32b00cdb50 2024-09-17T04:23:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.922+0000 7f32affff640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:50.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.923+0000 7f32affff640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 0x7f329c07b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32a0003700 tx=0x7f32a000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:50.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:50.927+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32b006a7e0 con 0x7f32b00cdb50 2024-09-17T04:23:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.114+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f32b00cef50 con 0x7f32b00cdb50 2024-09-17T04:23:51.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.118+0000 7f32acff9640 1 -- 172.21.15.63:0/4132093846 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f32a40830d0 con 0x7f32b00cdb50 2024-09-17T04:23:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 msgr2=0x7f329c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 0x7f329c07b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32a0003700 tx=0x7f32a000b260 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 msgr2=0x7f32b01514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32b00ba1b0 tx=0x7f32a4006d00 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 shutdown_connections 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f32b01519e0 0x7f32b01f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32b00cdb50 0x7f32b01514a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 --2- 172.21.15.63:0/4132093846 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3298004800 0x7f32b01f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 >> 172.21.15.63:0/4132093846 conn(0x7f32b008bfc0 msgr2=0x7f32b00b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 shutdown_connections 2024-09-17T04:23:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.120+0000 7f32b65ad640 1 -- 172.21.15.63:0/4132093846 wait complete. 2024-09-17T04:23:51.131 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T04:23:51.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T04:23:51.143 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:23:51.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T04:23:51.217 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T04:23:51.218 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:51.218 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:23:51.234 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:51.234 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.320 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:51.321 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:23:51.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.535+0000 7ff3efa94640 1 -- 172.21.15.63:0/403802815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 msgr2=0x7ff3d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.535+0000 7ff3efa94640 1 --2- 172.21.15.63:0/403802815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8006fd0 tx=0x7ff3d4005830 comp rx=0 tx=0).stop 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.536+0000 7ff3efa94640 1 -- 172.21.15.63:0/403802815 shutdown_connections 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.536+0000 7ff3efa94640 1 --2- 172.21.15.63:0/403802815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.536+0000 7ff3efa94640 1 -- 172.21.15.63:0/403802815 >> 172.21.15.63:0/403802815 conn(0x7ff3e809d7f0 msgr2=0x7ff3e80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.536+0000 7ff3efa94640 1 -- 172.21.15.63:0/403802815 shutdown_connections 2024-09-17T04:23:51.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.536+0000 7ff3efa94640 1 -- 172.21.15.63:0/403802815 wait complete. 2024-09-17T04:23:51.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.537+0000 7ff3efa94640 1 Processor -- start 2024-09-17T04:23:51.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.537+0000 7ff3efa94640 1 -- start start 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e8160420 0x7ff3e80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 0x7ff3e80ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80b6120 con 0x7ff3d4004800 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80b5fa0 con 0x7ff3e8160420 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80b62a0 con 0x7ff3e80c8d50 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:51.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40818/0 (socket says 172.21.15.63:40818) 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 -- 172.21.15.63:0/806876351 learned_addr learned my addr 172.21.15.63:0/806876351 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ee031640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 0x7ff3e80ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed02f640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e8160420 0x7ff3e80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 -- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 msgr2=0x7ff3e80ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 0x7ff3e80ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 -- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e8160420 msgr2=0x7ff3e80c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e8160420 0x7ff3e80c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 -- 172.21.15.63:0/806876351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e815f660 con 0x7ff3d4004800 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ee031640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 0x7ff3e80ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3ed830640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40066e0 tx=0x7ff3e400f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4015070 con 0x7ff3d4004800 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e4011900 con 0x7ff3d4004800 2024-09-17T04:23:51.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e815f940 con 0x7ff3d4004800 2024-09-17T04:23:51.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.539+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4011d30 con 0x7ff3d4004800 2024-09-17T04:23:51.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.540+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e80cd090 con 0x7ff3d4004800 2024-09-17T04:23:51.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.540+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e80b6800 con 0x7ff3d4004800 2024-09-17T04:23:51.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.541+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3e40103c0 con 0x7ff3d4004800 2024-09-17T04:23:51.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.542+0000 7ff3de7fc640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 0x7ff3cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:51.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.542+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3e409b8d0 con 0x7ff3d4004800 2024-09-17T04:23:51.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.542+0000 7ff3ed02f640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 0x7ff3cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:51.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.543+0000 7ff3ed02f640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 0x7ff3cc07b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8033000 tx=0x7ff3e80d3430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:51.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.547+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3e4063da0 con 0x7ff3d4004800 2024-09-17T04:23:51.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.742+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3e80cae80 con 0x7ff3d4004800 2024-09-17T04:23:51.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.742+0000 7ff3de7fc640 1 -- 172.21.15.63:0/806876351 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff3e40636a0 con 0x7ff3d4004800 2024-09-17T04:23:51.742 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 msgr2=0x7ff3cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 0x7ff3cc07b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8033000 tx=0x7ff3e80d3430 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 msgr2=0x7ff3e8161cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40066e0 tx=0x7ff3e400f7e0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 shutdown_connections 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff3cc078b90 0x7ff3cc07b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff3e8160420 0x7ff3e80c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff3e80c8d50 0x7ff3e80ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 --2- 172.21.15.63:0/806876351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3d4004800 0x7ff3e8161cd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 >> 172.21.15.63:0/806876351 conn(0x7ff3e809d7f0 msgr2=0x7ff3e80b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:51.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 shutdown_connections 2024-09-17T04:23:51.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:51.745+0000 7ff3efa94640 1 -- 172.21.15.63:0/806876351 wait complete. 2024-09-17T04:23:51.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T04:23:51.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:51.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T04:23:51.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:23:51.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:51.783 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T04:23:51.846 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:51.846 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.865 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:51.865 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.923 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:51.923 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:51.981 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:23:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 -- 172.21.15.63:0/3836848482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c98160c90 msgr2=0x7f0c980b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/3836848482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c98160c90 0x7f0c980b3e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c98074c90 tx=0x7f0c8c02a560 comp rx=0 tx=0).stop 2024-09-17T04:23:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 -- 172.21.15.63:0/3836848482 shutdown_connections 2024-09-17T04:23:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/3836848482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c98160c90 0x7f0c980b3e20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/3836848482 >> v2:172.21.15.112:3300/0 conn(0x7f0c980cff70 0x7f0c9815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 -- 172.21.15.63:0/3836848482 >> 172.21.15.63:0/3836848482 conn(0x7f0c980cee20 msgr2=0x7f0c980cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:52.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 -- 172.21.15.63:0/3836848482 shutdown_connections 2024-09-17T04:23:52.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.099+0000 7f0c9dccc640 1 -- 172.21.15.63:0/3836848482 wait complete. 2024-09-17T04:23:52.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.101+0000 7f0c9dccc640 1 Processor -- start 2024-09-17T04:23:52.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.101+0000 7f0c9dccc640 1 -- start start 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c980cff70 0x7f0c980b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c98160c90 0x7f0c980b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c98072ef0 con 0x7f0c980b4360 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0c980d1e50 con 0x7f0c98160c90 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c9dccc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0c98073070 con 0x7f0c980cff70 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40840/0 (socket says 172.21.15.63:40840) 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.102+0000 7f0c977fe640 1 -- 172.21.15.63:0/2455595170 learned_addr learned my addr 172.21.15.63:0/2455595170 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c96ffd640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c980cff70 0x7f0c980b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c97fff640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c98160c90 0x7f0c980b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 -- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c980cff70 msgr2=0x7f0c980b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c980cff70 0x7f0c980b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 -- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c98160c90 msgr2=0x7f0c980b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c98160c90 0x7f0c980b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 -- 172.21.15.63:0/2455595170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9814f4a0 con 0x7f0c980b4360 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c977fe640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800d6d0 tx=0x7f0c8800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:52.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88017070 con 0x7f0c980b4360 2024-09-17T04:23:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c88005330 con 0x7f0c980b4360 2024-09-17T04:23:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88009820 con 0x7f0c980b4360 2024-09-17T04:23:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c980c6100 con 0x7f0c980b4360 2024-09-17T04:23:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.103+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c98155940 con 0x7f0c980b4360 2024-09-17T04:23:52.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.104+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c980734d0 con 0x7f0c980b4360 2024-09-17T04:23:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.105+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c88009bd0 con 0x7f0c980b4360 2024-09-17T04:23:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.105+0000 7f0c7ffff640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 0x7f0c8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.106+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c8809ae50 con 0x7f0c980b4360 2024-09-17T04:23:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.106+0000 7f0c96ffd640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 0x7f0c8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.106+0000 7f0c96ffd640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 0x7f0c8407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c033000 tx=0x7f0c8c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:52.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.110+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c88062d60 con 0x7f0c980b4360 2024-09-17T04:23:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.310+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c9815b0d0 con 0x7f0c980b4360 2024-09-17T04:23:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.310+0000 7f0c7ffff640 1 -- 172.21.15.63:0/2455595170 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0c88067790 con 0x7f0c980b4360 2024-09-17T04:23:52.310 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T04:23:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.312+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 msgr2=0x7f0c8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.312+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 0x7f0c8407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c033000 tx=0x7f0c8c004730 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.312+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 msgr2=0x7f0c980c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.312+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800d6d0 tx=0x7f0c8800db90 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 shutdown_connections 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c84078bc0 0x7f0c8407b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0c98160c90 0x7f0c980b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0c980cff70 0x7f0c980b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 --2- 172.21.15.63:0/2455595170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c980b4360 0x7f0c980c6360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 >> 172.21.15.63:0/2455595170 conn(0x7f0c980cee20 msgr2=0x7f0c98158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 shutdown_connections 2024-09-17T04:23:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.313+0000 7f0c9dccc640 1 -- 172.21.15.63:0/2455595170 wait complete. 2024-09-17T04:23:52.323 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T04:23:52.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:52.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T04:23:52.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:23:52.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:52.356 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T04:23:52.425 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:52.425 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:52.442 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:52.442 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:52.499 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:23:52.499 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:52.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 -- 172.21.15.63:0/3081458238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 msgr2=0x7fb2200ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 --2- 172.21.15.63:0/3081458238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb2200ceb50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb208009830 tx=0x7fb20802a5c0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 -- 172.21.15.63:0/3081458238 shutdown_connections 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 --2- 172.21.15.63:0/3081458238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb2200ceb50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 -- 172.21.15.63:0/3081458238 >> 172.21.15.63:0/3081458238 conn(0x7fb2200b3f10 msgr2=0x7fb2200b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:52.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 -- 172.21.15.63:0/3081458238 shutdown_connections 2024-09-17T04:23:52.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.713+0000 7fb224d50640 1 -- 172.21.15.63:0/3081458238 wait complete. 2024-09-17T04:23:52.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.715+0000 7fb224d50640 1 Processor -- start 2024-09-17T04:23:52.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.715+0000 7fb224d50640 1 -- start start 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.716+0000 7fb224d50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.716+0000 7fb224d50640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 0x7fb2201f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2200d1d40 0x7fb22015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb2200d1440 con 0x7fb2200b5210 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb2200d12c0 con 0x7fb2200ccba0 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb2200d15c0 con 0x7fb2200d1d40 2024-09-17T04:23:52.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40864/0 (socket says 172.21.15.63:40864) 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 -- 172.21.15.63:0/3002381317 learned_addr learned my addr 172.21.15.63:0/3002381317 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21dd9b640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 0x7fb2201f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21ed9d640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2200d1d40 0x7fb22015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 -- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2200d1d40 msgr2=0x7fb22015e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2200d1d40 0x7fb22015e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 -- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 msgr2=0x7fb2201f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 0x7fb2201f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 -- 172.21.15.63:0/3002381317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2201f59e0 con 0x7fb2200b5210 2024-09-17T04:23:52.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21dd9b640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 0x7fb2201f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:52.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb21e59c640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c7b0 tx=0x7fb21000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210003b70 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb210003d10 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22006e020 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21000aab0 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.717+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22006e2c0 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.718+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2201f5bb0 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.719+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb21000ac50 con 0x7fb2200b5210 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.720+0000 7fb216ffd640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 0x7fb20007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:52.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.720+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb21009abc0 con 0x7fb2200b5210 2024-09-17T04:23:52.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.720+0000 7fb21dd9b640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 0x7fb20007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:52.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.721+0000 7fb21dd9b640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 0x7fb20007b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb208004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:52.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.725+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb210063120 con 0x7fb2200b5210 2024-09-17T04:23:52.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.923+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2200ceb50 con 0x7fb2200b5210 2024-09-17T04:23:52.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.923+0000 7fb216ffd640 1 -- 172.21.15.63:0/3002381317 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fb210062a20 con 0x7fb2200b5210 2024-09-17T04:23:52.923 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T04:23:52.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.925+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 msgr2=0x7fb20007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.925+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 0x7fb20007b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb208004730 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 msgr2=0x7fb220158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb21000c7b0 tx=0x7fb21000cc70 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 shutdown_connections 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb200078b90 0x7fb20007b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb2200ccba0 0x7fb2201f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb2200d1d40 0x7fb22015e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 --2- 172.21.15.63:0/3002381317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2200b5210 0x7fb220158f20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 >> 172.21.15.63:0/3002381317 conn(0x7fb2200b3f10 msgr2=0x7fb2200b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 shutdown_connections 2024-09-17T04:23:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:52.926+0000 7fb224d50640 1 -- 172.21.15.63:0/3002381317 wait complete. 2024-09-17T04:23:52.936 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T04:23:52.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:52.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T04:23:52.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:23:52.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:52.963 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T04:23:53.020 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:53.020 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:53.040 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:53.040 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:53.098 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:23:53.098 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:23:53.156 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:23:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 -- 172.21.15.63:0/2174854544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 msgr2=0x7fb4640cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 --2- 172.21.15.63:0/2174854544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640cff10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb454005fd0 tx=0x7fb45402a8b0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 -- 172.21.15.63:0/2174854544 shutdown_connections 2024-09-17T04:23:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 --2- 172.21.15.63:0/2174854544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640cff10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 -- 172.21.15.63:0/2174854544 >> 172.21.15.63:0/2174854544 conn(0x7fb4640cedc0 msgr2=0x7fb4640cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:53.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 -- 172.21.15.63:0/2174854544 shutdown_connections 2024-09-17T04:23:53.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.273+0000 7fb468fb0640 1 -- 172.21.15.63:0/2174854544 wait complete. 2024-09-17T04:23:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.275+0000 7fb468fb0640 1 Processor -- start 2024-09-17T04:23:53.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.275+0000 7fb468fb0640 1 -- start start 2024-09-17T04:23:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 0x7fb4641510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 0x7fb4640c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4640b6850 con 0x7fb46415c880 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb4640b66d0 con 0x7fb4640c81f0 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.276+0000 7fb468fb0640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb4640b69d0 con 0x7fb4640d1ef0 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40892/0 (socket says 172.21.15.63:40892) 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 -- 172.21.15.63:0/3115595844 learned_addr learned my addr 172.21.15.63:0/3115595844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb462d9d640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 0x7fb4640c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb46259c640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 0x7fb4641510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 -- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 msgr2=0x7fb4641510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 0x7fb4641510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 -- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 msgr2=0x7fb4640c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 0x7fb4640c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 -- 172.21.15.63:0/3115595844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4640c8b40 con 0x7fb46415c880 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb462d9d640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 0x7fb4640c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb46259c640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 0x7fb4641510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb461d9b640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00c3a0 tx=0x7fb44c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c017070 con 0x7fb46415c880 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb464153e80 con 0x7fb46415c880 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb44c0035f0 con 0x7fb46415c880 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c003a40 con 0x7fb46415c880 2024-09-17T04:23:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.277+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46415ecd0 con 0x7fb46415c880 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.278+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46415e710 con 0x7fb46415c880 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.279+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb44c01a070 con 0x7fb46415c880 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.280+0000 7fb45affd640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 0x7fb44407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.280+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb44c09a060 con 0x7fb46415c880 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.280+0000 7fb46259c640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 0x7fb44407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.281+0000 7fb46259c640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 0x7fb44407b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb454004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.284+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4640c8b40 con 0x7fb46415c880 2024-09-17T04:23:53.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.483+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4640cfef0 con 0x7fb46415c880 2024-09-17T04:23:53.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.483+0000 7fb45affd640 1 -- 172.21.15.63:0/3115595844 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fb44c0624b0 con 0x7fb46415c880 2024-09-17T04:23:53.483 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T04:23:53.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.485+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 msgr2=0x7fb44407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.485+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 0x7fb44407b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb454004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 msgr2=0x7fb4640c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00c3a0 tx=0x7fb44c00c860 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 shutdown_connections 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb444078b90 0x7fb44407b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb4640c81f0 0x7fb4640c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415c880 0x7fb4640c6570 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 --2- 172.21.15.63:0/3115595844 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb4640d1ef0 0x7fb4641510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 >> 172.21.15.63:0/3115595844 conn(0x7fb4640cedc0 msgr2=0x7fb4640b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 shutdown_connections 2024-09-17T04:23:53.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.486+0000 7fb468fb0640 1 -- 172.21.15.63:0/3115595844 wait complete. 2024-09-17T04:23:53.497 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T04:23:53.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:53.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T04:23:53.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:23:53.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:23:53.530 DEBUG:teuthology.orchestra.run.smithi112:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T04:23:53.588 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T04:23:53.588 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 -- 172.21.15.63:0/1278590586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6280d1d40 msgr2=0x7fb6280b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 --2- 172.21.15.63:0/1278590586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6280d1d40 0x7fb6280b5210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb628072650 tx=0x7fb62002a5f0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 -- 172.21.15.63:0/1278590586 shutdown_connections 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 --2- 172.21.15.63:0/1278590586 >> v2:172.21.15.112:3300/0 conn(0x7fb6280ccba0 0x7fb6280ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 --2- 172.21.15.63:0/1278590586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6280d1d40 0x7fb6280b5210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 -- 172.21.15.63:0/1278590586 >> 172.21.15.63:0/1278590586 conn(0x7fb6280b3f10 msgr2=0x7fb6280b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 -- 172.21.15.63:0/1278590586 shutdown_connections 2024-09-17T04:23:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.705+0000 7fb6301e6640 1 -- 172.21.15.63:0/1278590586 wait complete. 2024-09-17T04:23:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.707+0000 7fb6301e6640 1 Processor -- start 2024-09-17T04:23:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.707+0000 7fb6301e6640 1 -- start start 2024-09-17T04:23:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6280ccba0 0x7fb6281f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 0x7fb6281590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb6280d11f0 con 0x7fb62815c6f0 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6280d1070 con 0x7fb6280d1d40 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb6301e6640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb6280d1370 con 0x7fb6280ccba0 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb62e783640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb62e783640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40918/0 (socket says 172.21.15.63:40918) 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb62e783640 1 -- 172.21.15.63:0/2960108204 learned_addr learned my addr 172.21.15.63:0/2960108204 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.708+0000 7fb62d781640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 0x7fb6281590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62df82640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6280ccba0 0x7fb6281f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 -- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6280ccba0 msgr2=0x7fb6281f8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6280ccba0 0x7fb6281f8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 -- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 msgr2=0x7fb6281590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 0x7fb6281590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 -- 172.21.15.63:0/2960108204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6281f94c0 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62d781640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 0x7fb6281590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb62e783640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb61800e990 tx=0x7fb61800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618004d20 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb61800cb00 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618005020 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6281f97a0 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.709+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6280cb6d0 con 0x7fb62815c6f0 2024-09-17T04:23:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.710+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6280d1890 con 0x7fb62815c6f0 2024-09-17T04:23:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.711+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6180051c0 con 0x7fb62815c6f0 2024-09-17T04:23:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.711+0000 7fb6267fc640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 0x7fb61407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.711+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb61809b6b0 con 0x7fb62815c6f0 2024-09-17T04:23:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.712+0000 7fb62df82640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 0x7fb61407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:53.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.712+0000 7fb62df82640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 0x7fb61407b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb620033000 tx=0x7fb620004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:53.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.716+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb618016030 con 0x7fb62815c6f0 2024-09-17T04:23:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.935+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6281f9210 con 0x7fb62815c6f0 2024-09-17T04:23:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.936+0000 7fb6267fc640 1 -- 172.21.15.63:0/2960108204 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7fb618063af0 con 0x7fb62815c6f0 2024-09-17T04:23:53.936 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:53.936 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:53.936 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.937+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 msgr2=0x7fb61407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 0x7fb61407b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb620033000 tx=0x7fb620004730 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 msgr2=0x7fb6280c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb61800e990 tx=0x7fb61800ee50 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 shutdown_connections 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb614078b90 0x7fb61407b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6280d1d40 0x7fb6281590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb62815c6f0 0x7fb6280c93c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 --2- 172.21.15.63:0/2960108204 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6280ccba0 0x7fb6281f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 >> 172.21.15.63:0/2960108204 conn(0x7fb6280b3f10 msgr2=0x7fb6280b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 shutdown_connections 2024-09-17T04:23:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:53.938+0000 7fb6301e6640 1 -- 172.21.15.63:0/2960108204 wait complete. 2024-09-17T04:23:53.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 -- 172.21.15.63:0/242193236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6638162f60 msgr2=0x7f6638165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 --2- 172.21.15.63:0/242193236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6638162f60 0x7f6638165380 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6628005fd0 tx=0x7f662802a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 -- 172.21.15.63:0/242193236 shutdown_connections 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 --2- 172.21.15.63:0/242193236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6638162f60 0x7f6638165380 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 --2- 172.21.15.63:0/242193236 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 0x7f66380b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 -- 172.21.15.63:0/242193236 >> 172.21.15.63:0/242193236 conn(0x7f66380d12a0 msgr2=0x7f66380d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:54.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 -- 172.21.15.63:0/242193236 shutdown_connections 2024-09-17T04:23:54.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.065+0000 7f66402d5640 1 -- 172.21.15.63:0/242193236 wait complete. 2024-09-17T04:23:54.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.067+0000 7f66402d5640 1 Processor -- start 2024-09-17T04:23:54.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.067+0000 7f66402d5640 1 -- start start 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 0x7f663815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6638162f60 0x7f66380c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6638165a40 con 0x7f66380b6680 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f66381658c0 con 0x7f6638162f60 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f66402d5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6638165bc0 con 0x7f66380b6100 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f663d870640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f663d870640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40936/0 (socket says 172.21.15.63:40936) 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f663d870640 1 -- 172.21.15.63:0/688890896 learned_addr learned my addr 172.21.15.63:0/688890896 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f663e071640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 0x7f663815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.068+0000 7f663e872640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6638162f60 0x7f66380c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 -- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 msgr2=0x7f663815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 0x7f663815ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 -- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6638162f60 msgr2=0x7f66380c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6638162f60 0x7f66380c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 -- 172.21.15.63:0/688890896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663815f2a0 con 0x7f66380b6680 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f663d870640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e790 tx=0x7f662c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c00eea0 con 0x7f66380b6680 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f662c00cdb0 con 0x7f66380b6680 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663815f600 con 0x7f66380b6680 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c010690 con 0x7f66380b6680 2024-09-17T04:23:54.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.069+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66380c87f0 con 0x7f66380b6680 2024-09-17T04:23:54.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.070+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663815f840 con 0x7f66380b6680 2024-09-17T04:23:54.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.071+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f662c010830 con 0x7f66380b6680 2024-09-17T04:23:54.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.072+0000 7f6636ffd640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.072+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f662c09b600 con 0x7f66380b6680 2024-09-17T04:23:54.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.072+0000 7f663e071640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.072+0000 7f663e071640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 0x7f662407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66380ceda0 tx=0x7f6630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.076+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f663815f840 con 0x7f66380b6680 2024-09-17T04:23:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.299+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66380b0de0 con 0x7f66380b6680 2024-09-17T04:23:54.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.300+0000 7f6636ffd640 1 -- 172.21.15.63:0/688890896 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f662c063480 con 0x7f66380b6680 2024-09-17T04:23:54.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:54.300 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:54.300 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 msgr2=0x7f662407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 0x7f662407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f66380ceda0 tx=0x7f6630009040 comp rx=0 tx=0).stop 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 msgr2=0x7f66380c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e790 tx=0x7f662c00ec50 comp rx=0 tx=0).stop 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 shutdown_connections 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6624078b90 0x7f662407b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6638162f60 0x7f66380c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66380b6680 0x7f66380c5830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 --2- 172.21.15.63:0/688890896 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f66380b6100 0x7f663815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 >> 172.21.15.63:0/688890896 conn(0x7f66380d12a0 msgr2=0x7f66380d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:54.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 shutdown_connections 2024-09-17T04:23:54.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.302+0000 7f66402d5640 1 -- 172.21.15.63:0/688890896 wait complete. 2024-09-17T04:23:54.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:54.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.429+0000 7f646c8d5640 1 -- 172.21.15.63:0/1992395177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 msgr2=0x7f64680d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.429+0000 7f646c8d5640 1 --2- 172.21.15.63:0/1992395177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f64680d4d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6460009be0 tx=0x7f646002a790 comp rx=0 tx=0).stop 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.429+0000 7f646c8d5640 1 -- 172.21.15.63:0/1992395177 shutdown_connections 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.429+0000 7f646c8d5640 1 --2- 172.21.15.63:0/1992395177 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f64680d4d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.429+0000 7f646c8d5640 1 -- 172.21.15.63:0/1992395177 >> 172.21.15.63:0/1992395177 conn(0x7f646809d7f0 msgr2=0x7f64680d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.430+0000 7f646c8d5640 1 -- 172.21.15.63:0/1992395177 shutdown_connections 2024-09-17T04:23:54.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.430+0000 7f646c8d5640 1 -- 172.21.15.63:0/1992395177 wait complete. 2024-09-17T04:23:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.431+0000 7f646c8d5640 1 Processor -- start 2024-09-17T04:23:54.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.431+0000 7f646c8d5640 1 -- start start 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f646815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646815f690 0x7f64680cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f646806f790 con 0x7f64680cf540 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f646806f610 con 0x7f646815f690 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646c8d5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f646806f910 con 0x7f64680b9b60 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40946/0 (socket says 172.21.15.63:40946) 2024-09-17T04:23:54.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 -- 172.21.15.63:0/216599576 learned_addr learned my addr 172.21.15.63:0/216599576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6466d9d640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646815f690 0x7f64680cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f646659c640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f646815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 -- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 msgr2=0x7f646815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f646815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 -- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646815f690 msgr2=0x7f64680cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646815f690 0x7f64680cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.433+0000 7f6465d9b640 1 -- 172.21.15.63:0/216599576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646815fee0 con 0x7f64680cf540 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f6465d9b640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f645000c430 tx=0x7f645000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450017070 con 0x7f64680cf540 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64500053e0 con 0x7f64680cf540 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64680cc0a0 con 0x7f64680cf540 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450003850 con 0x7f64680cf540 2024-09-17T04:23:54.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.434+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64680cc660 con 0x7f64680cf540 2024-09-17T04:23:54.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.435+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64680d4d80 con 0x7f64680cf540 2024-09-17T04:23:54.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.436+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f645001a070 con 0x7f64680cf540 2024-09-17T04:23:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.436+0000 7f645effd640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 0x7f644807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.436+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6450099fe0 con 0x7f64680cf540 2024-09-17T04:23:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.437+0000 7f646659c640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 0x7f644807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.437+0000 7f646659c640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 0x7f644807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64680b6e20 tx=0x7f6460004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.441+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6450061e60 con 0x7f64680cf540 2024-09-17T04:23:54.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.629+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64680caed0 con 0x7f64680cf540 2024-09-17T04:23:54.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.630+0000 7f645effd640 1 -- 172.21.15.63:0/216599576 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f6450066890 con 0x7f64680cf540 2024-09-17T04:23:54.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:54.630 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:54.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 msgr2=0x7f644807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 0x7f644807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f64680b6e20 tx=0x7f6460004ab0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 msgr2=0x7f64680cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f645000c430 tx=0x7f645000c8f0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 shutdown_connections 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6448078bc0 0x7f644807b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f646815f690 0x7f64680cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.632+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64680cf540 0x7f64680cd870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.633+0000 7f646c8d5640 1 --2- 172.21.15.63:0/216599576 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f64680b9b60 0x7f646815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.633+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 >> 172.21.15.63:0/216599576 conn(0x7f646809d7f0 msgr2=0x7f64680b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.633+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 shutdown_connections 2024-09-17T04:23:54.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.633+0000 7f646c8d5640 1 -- 172.21.15.63:0/216599576 wait complete. 2024-09-17T04:23:54.644 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T04:23:54.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 -- 172.21.15.63:0/4004650324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f392c0039e0 msgr2=0x7f392c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 --2- 172.21.15.63:0/4004650324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f392c0039e0 0x7f392c003e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3930009ed0 tx=0x7f392c005830 comp rx=0 tx=0).stop 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f393ed9d640 1 -- 172.21.15.63:0/4004650324 reap_dead start 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 -- 172.21.15.63:0/4004650324 shutdown_connections 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 -- 172.21.15.63:0/4004650324 >> 172.21.15.63:0/4004650324 conn(0x7f394006def0 msgr2=0x7f394006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:54.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 -- 172.21.15.63:0/4004650324 shutdown_connections 2024-09-17T04:23:54.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.761+0000 7f3944e8c640 1 -- 172.21.15.63:0/4004650324 wait complete. 2024-09-17T04:23:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.763+0000 7f3944e8c640 1 Processor -- start 2024-09-17T04:23:54.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.763+0000 7f3944e8c640 1 -- start start 2024-09-17T04:23:54.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f392c0039e0 0x7f3940151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 0x7f39401f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b4e30 con 0x7f39401564b0 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b4cb0 con 0x7f3940156e00 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f3944e8c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f39400b4fb0 con 0x7f392c0039e0 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f393dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f393dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40964/0 (socket says 172.21.15.63:40964) 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.764+0000 7f393dd9b640 1 -- 172.21.15.63:0/547133845 learned_addr learned my addr 172.21.15.63:0/547133845 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393ed9d640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 0x7f39401f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393e59c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f392c0039e0 0x7f3940151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 -- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f392c0039e0 msgr2=0x7f3940151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f392c0039e0 0x7f3940151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 -- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 msgr2=0x7f39401f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 0x7f39401f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 -- 172.21.15.63:0/547133845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3940152330 con 0x7f39401564b0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393ed9d640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 0x7f39401f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f393dd9b640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3928004e20 tx=0x7f3928001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928010890 con 0x7f39401564b0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3928016070 con 0x7f39401564b0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3940157530 con 0x7f39401564b0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928010d60 con 0x7f39401564b0 2024-09-17T04:23:54.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.765+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394006da80 con 0x7f39401564b0 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.766+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394015c580 con 0x7f39401564b0 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.767+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f392801b460 con 0x7f39401564b0 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.768+0000 7f3936ffd640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.768+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f392809b6c0 con 0x7f39401564b0 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.768+0000 7f393e59c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:54.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.768+0000 7f393e59c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 0x7f392007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3930035000 tx=0x7f3930004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:54.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.772+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3940152330 con 0x7f39401564b0 2024-09-17T04:23:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.996+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f394006d810 con 0x7f39401564b0 2024-09-17T04:23:54.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.997+0000 7f3936ffd640 1 -- 172.21.15.63:0/547133845 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7f3928063b00 con 0x7f39401564b0 2024-09-17T04:23:54.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:54.997 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:54.997 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 msgr2=0x7f392007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 0x7f392007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3930035000 tx=0x7f3930004a40 comp rx=0 tx=0).stop 2024-09-17T04:23:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 msgr2=0x7f39401568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3928004e20 tx=0x7f3928001710 comp rx=0 tx=0).stop 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 shutdown_connections 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3920078bc0 0x7f392007b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3940156e00 0x7f39401f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39401564b0 0x7f39401568c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:54.999+0000 7f3944e8c640 1 --2- 172.21.15.63:0/547133845 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f392c0039e0 0x7f3940151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.000+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 >> 172.21.15.63:0/547133845 conn(0x7f394006def0 msgr2=0x7f394015ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.000+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 shutdown_connections 2024-09-17T04:23:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.000+0000 7f3944e8c640 1 -- 172.21.15.63:0/547133845 wait complete. 2024-09-17T04:23:55.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:23:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 -- 172.21.15.63:0/3746359314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6100 msgr2=0x7efbfc0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 --2- 172.21.15.63:0/3746359314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6100 0x7efbfc0b1320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0739d0 tx=0x7efbf002a5c0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 -- 172.21.15.63:0/3746359314 shutdown_connections 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 --2- 172.21.15.63:0/3746359314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 0x7efbfc164370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 --2- 172.21.15.63:0/3746359314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6100 0x7efbfc0b1320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 --2- 172.21.15.63:0/3746359314 >> v2:172.21.15.112:3300/0 conn(0x7efbfc0b6680 0x7efbfc0b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 -- 172.21.15.63:0/3746359314 >> 172.21.15.63:0/3746359314 conn(0x7efbfc0d12a0 msgr2=0x7efbfc0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 -- 172.21.15.63:0/3746359314 shutdown_connections 2024-09-17T04:23:55.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.127+0000 7efc00edd640 1 -- 172.21.15.63:0/3746359314 wait complete. 2024-09-17T04:23:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.129+0000 7efc00edd640 1 Processor -- start 2024-09-17T04:23:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.129+0000 7efc00edd640 1 -- start start 2024-09-17T04:23:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0b6100 0x7efbfc153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 0x7efbfc0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1648b0 con 0x7efbfc0b6680 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc0b20d0 con 0x7efbfc0b6100 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efc00edd640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc164a30 con 0x7efbfc161f50 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40982/0 (socket says 172.21.15.63:40982) 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 -- 172.21.15.63:0/2580577657 learned_addr learned my addr 172.21.15.63:0/2580577657 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbfa59c640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0b6100 0x7efbfc153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbfad9d640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 0x7efbfc0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 -- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 msgr2=0x7efbfc0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 0x7efbfc0b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 -- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0b6100 msgr2=0x7efbfc153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0b6100 0x7efbfc153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 -- 172.21.15.63:0/2580577657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1f3500 con 0x7efbfc0b6680 2024-09-17T04:23:55.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.131+0000 7efbf9d9b640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efbf0034040 tx=0x7efbf00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.132+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf003e030 con 0x7efbfc0b6680 2024-09-17T04:23:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.132+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf0003d90 con 0x7efbfc0b6680 2024-09-17T04:23:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.132+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc1f37e0 con 0x7efbfc0b6680 2024-09-17T04:23:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.132+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0035040 con 0x7efbfc0b6680 2024-09-17T04:23:55.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.132+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc070b90 con 0x7efbfc0b6680 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.133+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc0b0de0 con 0x7efbfc0b6680 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.133+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efbf0041030 con 0x7efbfc0b6680 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.134+0000 7efbeaffd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 0x7efbdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.134+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efbf00bb340 con 0x7efbfc0b6680 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.134+0000 7efbfa59c640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 0x7efbdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.135+0000 7efbfa59c640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 0x7efbdc07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0ceda0 tx=0x7efbec00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.139+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efbf00831c0 con 0x7efbfc0b6680 2024-09-17T04:23:55.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.366+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbfc0ce1f0 con 0x7efbfc0b6680 2024-09-17T04:23:55.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.367+0000 7efbeaffd640 1 -- 172.21.15.63:0/2580577657 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5217 (secure 0 0 0) 0x7efbf0087bf0 con 0x7efbfc0b6680 2024-09-17T04:23:55.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:55.367 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-17T04:23:28:381271+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/901987492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":901987492},{"type":"v1","addr":"172.21.15.112:6837","nonce":901987492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/743870040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":743870040},{"type":"v1","addr":"172.21.15.63:6833","nonce":743870040}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4381,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2738928226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2738928226},{"type":"v1","addr":"172.21.15.63:6835","nonce":2738928226}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:23:24.713173+0000","modified":"2024-09-17T04:23:27.760800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4393},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4393":{"gid":4393,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.112:6836/3142788505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6835","nonce":3142788505},{"type":"v1","addr":"172.21.15.112:6836","nonce":3142788505}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4393,"qdb_cluster":[4393]},"id":1}]} 2024-09-17T04:23:55.367 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-17T04:23:55.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 msgr2=0x7efbdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 0x7efbdc07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0ceda0 tx=0x7efbec00b260 comp rx=0 tx=0).stop 2024-09-17T04:23:55.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 msgr2=0x7efbfc09c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efbf0034040 tx=0x7efbf00038a0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 shutdown_connections 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7efbdc078b90 0x7efbdc07b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7efbfc161f50 0x7efbfc0b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efbfc0b6680 0x7efbfc09c740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 --2- 172.21.15.63:0/2580577657 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7efbfc0b6100 0x7efbfc153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 >> 172.21.15.63:0/2580577657 conn(0x7efbfc0d12a0 msgr2=0x7efbfc0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 shutdown_connections 2024-09-17T04:23:55.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.369+0000 7efc00edd640 1 -- 172.21.15.63:0/2580577657 wait complete. 2024-09-17T04:23:55.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:23:55.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 -- 172.21.15.63:0/3257252911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d0006e0e0 msgr2=0x7f0d0006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3257252911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d0006e0e0 0x7f0d0006e4f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8005fd0 tx=0x7f0cf802a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 -- 172.21.15.63:0/3257252911 shutdown_connections 2024-09-17T04:23:55.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3257252911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d0006e0e0 0x7f0d0006e4f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3257252911 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d000b66b0 0x7f0d000b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 -- 172.21.15.63:0/3257252911 >> 172.21.15.63:0/3257252911 conn(0x7f0d0009d7f0 msgr2=0x7f0d000d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 -- 172.21.15.63:0/3257252911 shutdown_connections 2024-09-17T04:23:55.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.499+0000 7f0d07deb640 1 -- 172.21.15.63:0/3257252911 wait complete. 2024-09-17T04:23:55.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.501+0000 7f0d07deb640 1 Processor -- start 2024-09-17T04:23:55.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.501+0000 7f0d07deb640 1 -- start start 2024-09-17T04:23:55.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d0006e0e0 0x7f0d001f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d000b9970 0x7f0d000cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0006ea30 con 0x7f0d000b4e60 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0d000d5050 con 0x7f0d000b9970 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d07deb640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0006ebb0 con 0x7f0d0006e0e0 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d06388640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d06388640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41012/0 (socket says 172.21.15.63:41012) 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.502+0000 7f0d06388640 1 -- 172.21.15.63:0/3668740411 learned_addr learned my addr 172.21.15.63:0/3668740411 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d05386640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d000b9970 0x7f0d000cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d05b87640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d0006e0e0 0x7f0d001f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 -- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d0006e0e0 msgr2=0x7f0d001f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d0006e0e0 0x7f0d001f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 -- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d000b9970 msgr2=0x7f0d000cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d000b9970 0x7f0d000cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 -- 172.21.15.63:0/3668740411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d000b57b0 con 0x7f0d000b4e60 2024-09-17T04:23:55.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d06388640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006010 tx=0x7f0cf8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf803e030 con 0x7f0d000b4e60 2024-09-17T04:23:55.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cf8003c20 con 0x7f0d000b4e60 2024-09-17T04:23:55.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d001f5810 con 0x7f0d000b4e60 2024-09-17T04:23:55.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8035040 con 0x7f0d000b4e60 2024-09-17T04:23:55.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.503+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d001f5dd0 con 0x7f0d000b4e60 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.504+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d001f5580 con 0x7f0d000b4e60 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.505+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cf8041030 con 0x7f0d000b4e60 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.506+0000 7f0cf67fc640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 0x7f0ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.506+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0cf80bb210 con 0x7f0d000b4e60 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.506+0000 7f0d05b87640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 0x7f0ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.506+0000 7f0d05b87640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 0x7f0ce407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc007fd0 tx=0x7f0cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.510+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0d000b57b0 con 0x7f0d000b4e60 2024-09-17T04:23:55.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.699+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d0006f080 con 0x7f0d000b4e60 2024-09-17T04:23:55.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.700+0000 7f0cf67fc640 1 -- 172.21.15.63:0/3668740411 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16641 (secure 0 0 0) 0x7f0cf8083090 con 0x7f0d000b4e60 2024-09-17T04:23:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:23:55.700 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:23:26.353431+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:23:22.622503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T04:23:23.678624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 msgr2=0x7f0ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 0x7f0ce407b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc007fd0 tx=0x7f0cfc009040 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 msgr2=0x7f0d000b5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006010 tx=0x7f0cf8003820 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 shutdown_connections 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0ce4078b90 0x7f0ce407b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0d000b9970 0x7f0d000cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d000b4e60 0x7f0d000b5270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 --2- 172.21.15.63:0/3668740411 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0d0006e0e0 0x7f0d001f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 >> 172.21.15.63:0/3668740411 conn(0x7f0d0009d7f0 msgr2=0x7f0d0015e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 shutdown_connections 2024-09-17T04:23:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.703+0000 7f0d07deb640 1 -- 172.21.15.63:0/3668740411 wait complete. 2024-09-17T04:23:55.714 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T04:23:55.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.832+0000 7fd7c552b640 1 -- 172.21.15.63:0/1056946640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 msgr2=0x7fd7ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.832+0000 7fd7c552b640 1 --2- 172.21.15.63:0/1056946640 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7ac00b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800c640 tx=0x7fd7ac005830 comp rx=0 tx=0).stop 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.832+0000 7fd7bf7fe640 1 -- 172.21.15.63:0/1056946640 reap_dead start 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.832+0000 7fd7c552b640 1 -- 172.21.15.63:0/1056946640 shutdown_connections 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.832+0000 7fd7c552b640 1 -- 172.21.15.63:0/1056946640 >> 172.21.15.63:0/1056946640 conn(0x7fd7c006def0 msgr2=0x7fd7c006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.833+0000 7fd7c552b640 1 -- 172.21.15.63:0/1056946640 shutdown_connections 2024-09-17T04:23:55.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.833+0000 7fd7c552b640 1 -- 172.21.15.63:0/1056946640 wait complete. 2024-09-17T04:23:55.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.834+0000 7fd7c552b640 1 Processor -- start 2024-09-17T04:23:55.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.834+0000 7fd7c552b640 1 -- start start 2024-09-17T04:23:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7c00b03d0 0x7fd7c0143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7c01f8ed0 0x7fd7c01f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0074690 con 0x7fd7ac005210 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00d04d0 con 0x7fd7c00b03d0 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c0074810 con 0x7fd7c01f8ed0 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41038/0 (socket says 172.21.15.63:41038) 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 -- 172.21.15.63:0/2514532712 learned_addr learned my addr 172.21.15.63:0/2514532712 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7bf7fe640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7c01f8ed0 0x7fd7c01f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7b7fff640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7c00b03d0 0x7fd7c0143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 -- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7c01f8ed0 msgr2=0x7fd7c01f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7c01f8ed0 0x7fd7c01f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 -- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7c00b03d0 msgr2=0x7fd7c0143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7c00b03d0 0x7fd7c0143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 -- 172.21.15.63:0/2514532712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c00cae10 con 0x7fd7ac005210 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7beffd640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0011a40 tx=0x7fd7b0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b001e070 con 0x7fd7ac005210 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b0019430 con 0x7fd7ac005210 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.836+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c00cb0f0 con 0x7fd7ac005210 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.837+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0019800 con 0x7fd7ac005210 2024-09-17T04:23:55.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.837+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c01f9820 con 0x7fd7ac005210 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.837+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0074da0 con 0x7fd7ac005210 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.838+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7b0021070 con 0x7fd7ac005210 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.839+0000 7fd7b77fe640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.839+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7b009b970 con 0x7fd7ac005210 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.839+0000 7fd7b7fff640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:55.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.839+0000 7fd7b7fff640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00cd0c0 tx=0x7fd7a8006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:55.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:55.843+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7b00637f0 con 0x7fd7ac005210 2024-09-17T04:23:56.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.069+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd7c00d19f0 con 0x7fd7ac005210 2024-09-17T04:23:56.069 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-17T04:23:56.070+0000 7f547533d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:23:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.071+0000 7fd7b77fe640 1 -- 172.21.15.63:0/2514532712 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fd7b0068220 con 0x7fd7ac005210 2024-09-17T04:23:56.071 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 msgr2=0x7fd7a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00cd0c0 tx=0x7fd7a8006b10 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 msgr2=0x7fd7c00a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0011a40 tx=0x7fd7b0011f00 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 shutdown_connections 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd7a0078bc0 0x7fd7a007b0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd7c00b03d0 0x7fd7c0143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd7c01f8ed0 0x7fd7c01f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 --2- 172.21.15.63:0/2514532712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ac005210 0x7fd7c00a9da0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 >> 172.21.15.63:0/2514532712 conn(0x7fd7c006def0 msgr2=0x7fd7c00b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 shutdown_connections 2024-09-17T04:23:56.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.074+0000 7fd7c552b640 1 -- 172.21.15.63:0/2514532712 wait complete. 2024-09-17T04:23:56.077 INFO:tasks.ceph.mds.b.smithi112.stderr: -8284> 2024-09-17T04:23:19.314+0000 7f7dd0b78640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T04:23:56.079 INFO:tasks.ceph.mds.b.smithi112.stderr: -6881> 2024-09-17T04:23:30.322+0000 7f7dcab6c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T04:23:56.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T04:23:56.138 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 -- 172.21.15.63:0/1568994378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38980d2460 msgr2=0x7f389815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 --2- 172.21.15.63:0/1568994378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38980d2460 0x7f389815d130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f388c005fd0 tx=0x7f388c02a5d0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 -- 172.21.15.63:0/1568994378 shutdown_connections 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 --2- 172.21.15.63:0/1568994378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38980d2460 0x7f389815d130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 --2- 172.21.15.63:0/1568994378 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38981570e0 0x7f38980d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 -- 172.21.15.63:0/1568994378 >> 172.21.15.63:0/1568994378 conn(0x7f389806d550 msgr2=0x7f3898071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 -- 172.21.15.63:0/1568994378 shutdown_connections 2024-09-17T04:23:56.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.204+0000 7f389cc4d640 1 -- 172.21.15.63:0/1568994378 wait complete. 2024-09-17T04:23:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.206+0000 7f389cc4d640 1 Processor -- start 2024-09-17T04:23:56.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.206+0000 7f389cc4d640 1 -- start start 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38980d2460 0x7f38980b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f389815d670 0x7f38980cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38980b7f30 con 0x7f38981570e0 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f38980b7db0 con 0x7f38980d2460 2024-09-17T04:23:56.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389cc4d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f38980b80b0 con 0x7f389815d670 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f3895d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f3895d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41050/0 (socket says 172.21.15.63:41050) 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f3895d9b640 1 -- 172.21.15.63:0/4149821546 learned_addr learned my addr 172.21.15.63:0/4149821546 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f389659c640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38980d2460 0x7f38980b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.207+0000 7f3896d9d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f389815d670 0x7f38980cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 -- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f389815d670 msgr2=0x7f38980cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f389815d670 0x7f38980cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 -- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38980d2460 msgr2=0x7f38980b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38980d2460 0x7f38980b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 -- 172.21.15.63:0/4149821546 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3898149880 con 0x7f38981570e0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3895d9b640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f388c034040 tx=0x7f388c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03e030 con 0x7f38981570e0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f388c003ae0 con 0x7f38981570e0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3898149b60 con 0x7f38981570e0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c035040 con 0x7f38981570e0 2024-09-17T04:23:56.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.208+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389814a120 con 0x7f38981570e0 2024-09-17T04:23:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.209+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389815d130 con 0x7f38981570e0 2024-09-17T04:23:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.210+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f388c041030 con 0x7f38981570e0 2024-09-17T04:23:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.210+0000 7f3886ffd640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 0x7f387807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:56.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.211+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f388c0bb4e0 con 0x7f38981570e0 2024-09-17T04:23:56.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.211+0000 7f389659c640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 0x7f387807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:56.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.211+0000 7f389659c640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 0x7f387807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3888009bb0 tx=0x7f3888005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:56.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.215+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f388c083300 con 0x7f38981570e0 2024-09-17T04:23:56.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:56.438+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38981f7f20 con 0x7f38981570e0 2024-09-17T04:23:57.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.077+0000 7f3886ffd640 1 -- 172.21.15.63:0/4149821546 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f388c087d30 con 0x7f38981570e0 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 msgr2=0x7f387807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 0x7f387807b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3888009bb0 tx=0x7f3888005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 msgr2=0x7f38981f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f388c034040 tx=0x7f388c0035f0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 shutdown_connections 2024-09-17T04:23:57.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3878078bc0 0x7f387807b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f389815d670 0x7f38980cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38981570e0 0x7f38981f7420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 --2- 172.21.15.63:0/4149821546 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38980d2460 0x7f38980b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 >> 172.21.15.63:0/4149821546 conn(0x7f389806d550 msgr2=0x7f38980b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 shutdown_connections 2024-09-17T04:23:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.080+0000 7f389cc4d640 1 -- 172.21.15.63:0/4149821546 wait complete. 2024-09-17T04:23:57.093 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T04:23:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 -- 172.21.15.63:0/4268644542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9270003fd0 msgr2=0x7f9270004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 --2- 172.21.15.63:0/4268644542 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9270003fd0 0x7f9270004800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92880d1780 tx=0x7f9270005830 comp rx=0 tx=0).stop 2024-09-17T04:23:57.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f9286d9d640 1 -- 172.21.15.63:0/4268644542 reap_dead start 2024-09-17T04:23:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 -- 172.21.15.63:0/4268644542 shutdown_connections 2024-09-17T04:23:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 -- 172.21.15.63:0/4268644542 >> 172.21.15.63:0/4268644542 conn(0x7f92880b3ea0 msgr2=0x7f92880b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 -- 172.21.15.63:0/4268644542 shutdown_connections 2024-09-17T04:23:57.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.217+0000 7f928cf6e640 1 -- 172.21.15.63:0/4268644542 wait complete. 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.219+0000 7f928cf6e640 1 Processor -- start 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.219+0000 7f928cf6e640 1 -- start start 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 0x7f92880b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9288158670 0x7f928814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f928815d9b0 con 0x7f92880c8430 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f928815d830 con 0x7f9270003fd0 2024-09-17T04:23:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f928815db30 con 0x7f9288158670 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41064/0 (socket says 172.21.15.63:41064) 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 -- 172.21.15.63:0/3015700314 learned_addr learned my addr 172.21.15.63:0/3015700314 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9285d9b640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9288158670 0x7f928814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928659c640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 0x7f92880b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 -- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9288158670 msgr2=0x7f928814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9288158670 0x7f928814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 -- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 msgr2=0x7f92880b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 0x7f92880b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 -- 172.21.15.63:0/3015700314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92880c8d80 con 0x7f92880c8430 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928659c640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 0x7f92880b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:23:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9286d9d640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92880ce2c0 tx=0x7f9280006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928000fc90 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9280018070 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92880b2a40 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.221+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280006970 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.222+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881f4580 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.222+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928815c5e0 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.223+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f928001d460 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.224+0000 7f9276ffd640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 0x7f926807b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.224+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f928009b6d0 con 0x7f92880c8430 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.224+0000 7f928659c640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 0x7f926807b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:57.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.225+0000 7f928659c640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 0x7f926807b240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9278009c50 tx=0x7f9278005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:57.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.229+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9280063ac0 con 0x7f92880c8430 2024-09-17T04:23:57.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:57.416+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f928815e3f0 con 0x7f92880c8430 2024-09-17T04:23:58.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.078+0000 7f9276ffd640 1 -- 172.21.15.63:0/3015700314 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f92800633c0 con 0x7f92880c8430 2024-09-17T04:23:58.079 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-17T04:23:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 msgr2=0x7f926807b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 0x7f926807b240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9278009c50 tx=0x7f9278005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 msgr2=0x7f92880c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f92880ce2c0 tx=0x7f9280006720 comp rx=0 tx=0).stop 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 shutdown_connections 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9268078d30 0x7f926807b240 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9278009c50 tx=0x7f9278005f90 comp rx=0 tx=0).stop 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92880c8430 0x7f92880c8840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9288158670 0x7f928814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 --2- 172.21.15.63:0/3015700314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9270003fd0 0x7f92880b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.082+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 >> 172.21.15.63:0/3015700314 conn(0x7f92880b3ea0 msgr2=0x7f928815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.083+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 shutdown_connections 2024-09-17T04:23:58.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.083+0000 7f928cf6e640 1 -- 172.21.15.63:0/3015700314 wait complete. 2024-09-17T04:23:58.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T04:23:58.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 -- 172.21.15.63:0/2013986627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc160f70 msgr2=0x7f72dc0d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 --2- 172.21.15.63:0/2013986627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc160f70 0x7f72dc0d0160 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f72cc005fd0 tx=0x7f72cc02a820 comp rx=0 tx=0).stop 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 -- 172.21.15.63:0/2013986627 shutdown_connections 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 --2- 172.21.15.63:0/2013986627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc160f70 0x7f72dc0d0160 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 --2- 172.21.15.63:0/2013986627 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc0cf3d0 0x7f72dc160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.220+0000 7f72e3720640 1 -- 172.21.15.63:0/2013986627 >> 172.21.15.63:0/2013986627 conn(0x7f72dc06d550 msgr2=0x7f72dc071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.221+0000 7f72e3720640 1 -- 172.21.15.63:0/2013986627 shutdown_connections 2024-09-17T04:23:58.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.221+0000 7f72e3720640 1 -- 172.21.15.63:0/2013986627 wait complete. 2024-09-17T04:23:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.222+0000 7f72e3720640 1 Processor -- start 2024-09-17T04:23:58.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.222+0000 7f72e3720640 1 -- start start 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc160f70 0x7f72dc0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc1e8450 0x7f72dc1e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc0d08b0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc161540 con 0x7f72dc1e8450 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e3720640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc0d0a30 con 0x7f72dc160f70 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41082/0 (socket says 172.21.15.63:41082) 2024-09-17T04:23:58.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 -- 172.21.15.63:0/4083624747 learned_addr learned my addr 172.21.15.63:0/4083624747 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e0cbb640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc160f70 0x7f72dc0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e1cbd640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc1e8450 0x7f72dc1e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 -- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc160f70 msgr2=0x7f72dc0b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc160f70 0x7f72dc0b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 -- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc1e8450 msgr2=0x7f72dc1e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc1e8450 0x7f72dc1e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 -- 172.21.15.63:0/4083624747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc1515d0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.224+0000 7f72e14bc640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c3c0 tx=0x7f72d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.225+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4017070 con 0x7f72dc0ccb70 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.225+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc1e8da0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.225+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72d40035f0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.225+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d4003a80 con 0x7f72dc0ccb70 2024-09-17T04:23:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.225+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc0c62c0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.226+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0d0f50 con 0x7f72dc0ccb70 2024-09-17T04:23:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.227+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72d401a070 con 0x7f72dc0ccb70 2024-09-17T04:23:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.227+0000 7f72d9ffb640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 0x7f72c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.227+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f72d4099e10 con 0x7f72dc0ccb70 2024-09-17T04:23:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.228+0000 7f72e0cbb640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 0x7f72c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:58.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.228+0000 7f72e0cbb640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 0x7f72c807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72dc071860 tx=0x7f72d000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:58.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.232+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72dc1e8da0 con 0x7f72dc0ccb70 2024-09-17T04:23:58.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:58.493+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f72dc0d1f80 con 0x7f72dc0ccb70 2024-09-17T04:23:59.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.084+0000 7f72d9ffb640 1 -- 172.21.15.63:0/4083624747 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f72d4061d70 con 0x7f72dc0ccb70 2024-09-17T04:23:59.084 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 msgr2=0x7f72c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 0x7f72c807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72dc071860 tx=0x7f72d000b2e0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 msgr2=0x7f72dc151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72d400c3c0 tx=0x7f72d400c880 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 shutdown_connections 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72c8078bc0 0x7f72c807b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72dc1e8450 0x7f72dc1e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72dc160f70 0x7f72dc0b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 --2- 172.21.15.63:0/4083624747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72dc0ccb70 0x7f72dc151090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 >> 172.21.15.63:0/4083624747 conn(0x7f72dc06d550 msgr2=0x7f72dc151fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:59.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 shutdown_connections 2024-09-17T04:23:59.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.087+0000 7f72e3720640 1 -- 172.21.15.63:0/4083624747 wait complete. 2024-09-17T04:23:59.100 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T04:23:59.100 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T04:23:59.100 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T04:23:59.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:23:59.101 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T04:23:59.101 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T04:23:59.101 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T04:23:59.101 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:23:59.101 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T04:23:59.101 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T04:23:59.101 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T04:23:59.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:23:59.102 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T04:23:59.102 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T04:23:59.102 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T04:23:59.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:23:59.110 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T04:23:59.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T04:23:59.111 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T04:23:59.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T04:23:59.114 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T04:23:59.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T04:23:59.115 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T04:23:59.116 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T04:23:59.153 INFO:tasks.ceph.mds.a:Started 2024-09-17T04:23:59.153 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:59.154 INFO:tasks.ceph.mds.c:Started 2024-09-17T04:23:59.154 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:59.160 INFO:tasks.ceph.mds.d:Started 2024-09-17T04:23:59.161 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:59.162 INFO:tasks.ceph.mds.b:Started 2024-09-17T04:23:59.162 DEBUG:teuthology.parallel:result is None 2024-09-17T04:23:59.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T04:23:59.242 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-17T04:23:59.243 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-09-17T04:23:59.253 INFO:tasks.ceph.mds.d.smithi112.stdout:starting mds.d at 2024-09-17T04:23:59.254 INFO:tasks.ceph.mds.b.smithi112.stdout:starting mds.b at 2024-09-17T04:23:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 -- 172.21.15.63:0/3781665608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800b51c0 msgr2=0x7f5b8015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 --2- 172.21.15.63:0/3781665608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800b51c0 0x7f5b8015c6e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b80073b60 tx=0x7f5b7002a5f0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 -- 172.21.15.63:0/3781665608 shutdown_connections 2024-09-17T04:23:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 --2- 172.21.15.63:0/3781665608 >> v2:172.21.15.112:3300/0 conn(0x7f5b800ccbd0 0x7f5b800d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 --2- 172.21.15.63:0/3781665608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800b51c0 0x7f5b8015c6e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 -- 172.21.15.63:0/3781665608 >> 172.21.15.63:0/3781665608 conn(0x7f5b80072ae0 msgr2=0x7f5b80072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:23:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 -- 172.21.15.63:0/3781665608 shutdown_connections 2024-09-17T04:23:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.286+0000 7f5b84982640 1 -- 172.21.15.63:0/3781665608 wait complete. 2024-09-17T04:23:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.288+0000 7f5b84982640 1 Processor -- start 2024-09-17T04:23:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.288+0000 7f5b84982640 1 -- start start 2024-09-17T04:23:59.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:59.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 0x7f5b800cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:59.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 0x7f5b8015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:59.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b800d19f0 con 0x7f5b800d12c0 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f5b80160a60 con 0x7f5b800ccbd0 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b84982640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f5b800c7fd0 con 0x7f5b800b51c0 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b77fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 0x7f5b800cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3301/0 says I am v2:172.21.15.63:45086/0 (socket says 172.21.15.63:45086) 2024-09-17T04:23:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b77fff640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 0x7f5b800cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.112:3300/0 says I am v2:172.21.15.63:55512/0 (socket says 172.21.15.63:55512) 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 -- 172.21.15.63:0/853763081 learned_addr learned my addr 172.21.15.63:0/853763081 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7ed9d640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 0x7f5b8015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 -- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 msgr2=0x7f5b800cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 0x7f5b800cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 -- 172.21.15.63:0/853763081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 msgr2=0x7f5b8015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:23:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 0x7f5b8015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 -- 172.21.15.63:0/853763081 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b800c9c50 con 0x7f5b800b51c0 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7ed9d640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 0x7f5b8015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.290+0000 7f5b7e59c640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b70034040 tx=0x7f5b70003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.291+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7003e030 con 0x7f5b800b51c0 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.291+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b70003d10 con 0x7f5b800b51c0 2024-09-17T04:23:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.291+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b800c9f30 con 0x7f5b800b51c0 2024-09-17T04:23:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.291+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b800ca4f0 con 0x7f5b800b51c0 2024-09-17T04:23:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.292+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70035040 con 0x7f5b800b51c0 2024-09-17T04:23:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.292+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b80160f10 con 0x7f5b800b51c0 2024-09-17T04:23:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.292+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b70041030 con 0x7f5b800b51c0 2024-09-17T04:23:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.293+0000 7f5b76ffd640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:23:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.293+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f5b700bb010 con 0x7f5b800b51c0 2024-09-17T04:23:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.293+0000 7f5b77fff640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:23:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.294+0000 7f5b77fff640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 0x7f5b6007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b8015c100 tx=0x7f5b68012040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:23:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.298+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b70083190 con 0x7f5b800b51c0 2024-09-17T04:23:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:23:59.501+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5b800cf720 con 0x7f5b800b51c0 2024-09-17T04:24:00.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.104+0000 7f5b76ffd640 1 -- 172.21.15.63:0/853763081 <== mon.2 v2:172.21.15.112:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f5b70087bc0 con 0x7f5b800b51c0 2024-09-17T04:24:00.104 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blocklist entries 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 msgr2=0x7f5b6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 0x7f5b6007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b8015c100 tx=0x7f5b68012040 comp rx=0 tx=0).stop 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 msgr2=0x7f5b801f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b70034040 tx=0x7f5b70003820 comp rx=0 tx=0).stop 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 shutdown_connections 2024-09-17T04:24:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f5b800ccbd0 0x7f5b800cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b800d12c0 0x7f5b8015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 --2- 172.21.15.63:0/853763081 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f5b800b51c0 0x7f5b801f4770 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 >> 172.21.15.63:0/853763081 conn(0x7f5b80072ae0 msgr2=0x7f5b80068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 shutdown_connections 2024-09-17T04:24:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.107+0000 7f5b84982640 1 -- 172.21.15.63:0/853763081 wait complete. 2024-09-17T04:24:00.121 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 -- 172.21.15.63:0/2845064588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070440 msgr2=0x7fd2b0074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 --2- 172.21.15.63:0/2845064588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070440 0x7fd2b0074b80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009830 tx=0x7fd2a802a510 comp rx=0 tx=0).stop 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 -- 172.21.15.63:0/2845064588 shutdown_connections 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 --2- 172.21.15.63:0/2845064588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070440 0x7fd2b0074b80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 --2- 172.21.15.63:0/2845064588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0070030 0x7fd2b0074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 -- 172.21.15.63:0/2845064588 >> 172.21.15.63:0/2845064588 conn(0x7fd2b00b1cb0 msgr2=0x7fd2b00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:00.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 -- 172.21.15.63:0/2845064588 shutdown_connections 2024-09-17T04:24:00.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.243+0000 7fd2b504d640 1 -- 172.21.15.63:0/2845064588 wait complete. 2024-09-17T04:24:00.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.245+0000 7fd2b504d640 1 Processor -- start 2024-09-17T04:24:00.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.245+0000 7fd2b504d640 1 -- start start 2024-09-17T04:24:00.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0070440 0x7fd2b009c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0073170 0x7fd2b014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00b3a90 con 0x7fd2b0070030 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b00b3910 con 0x7fd2b0070440 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2b504d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b00b3c10 con 0x7fd2b0073170 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.246+0000 7fd2aed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41154/0 (socket says 172.21.15.63:41154) 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 -- 172.21.15.63:0/221072611 learned_addr learned my addr 172.21.15.63:0/221072611 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:00.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2af59e640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0073170 0x7fd2b014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2ae59c640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0070440 0x7fd2b009c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 -- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0073170 msgr2=0x7fd2b014cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0073170 0x7fd2b014cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 -- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0070440 msgr2=0x7fd2b009c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0070440 0x7fd2b009c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 -- 172.21.15.63:0/221072611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b009aff0 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2aed9d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c7a0 tx=0x7fd2a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0017070 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2a0005070 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b009b2d0 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00054a0 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.247+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b009b890 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.248+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b00b4150 con 0x7fd2b0070030 2024-09-17T04:24:00.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.249+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2a001a070 con 0x7fd2b0070030 2024-09-17T04:24:00.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.249+0000 7fd2a77fe640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 0x7fd29007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.250+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd2a0099f80 con 0x7fd2b0070030 2024-09-17T04:24:00.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.250+0000 7fd2ae59c640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 0x7fd29007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.250+0000 7fd2ae59c640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 0x7fd29007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd298005fd0 tx=0x7fd298005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:00.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.254+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2a0062830 con 0x7fd2b0070030 2024-09-17T04:24:00.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.512+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd2b00c3860 con 0x7fd2b0070030 2024-09-17T04:24:00.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.513+0000 7fd2a77fe640 1 -- 172.21.15.63:0/221072611 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+6645 (secure 0 0 0) 0x7fd2a0062130 con 0x7fd2b0070030 2024-09-17T04:24:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:00.513 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:24:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2024-09-17T04:24:00.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lm4z1TJRAAcY7YA3PrBlxgCe/VRLYmHg==", 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.514 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lmP2aTMhAAbr6riE9JzM153ba6SEtGQQ==", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.c", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lmtG09LRAA5SCBQMugKdve1KWPgNC0eg==", 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.515 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.d", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lmJ5AzOhAAtli+UjX+PbvUkeGDsFwAnA==", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQADBOlm4iwLGRAAdGecgArgUSGrSEqYjjWrbQ==", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAGBOlmLzm4ORAAWAzT9Y4Py1pDcTvKgc0oaQ==", 2024-09-17T04:24:00.517 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAKBOlmMhwlARAAyt46K3FOqY+0+HbIUalBOw==", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQANBOlm4VmKAxAA7ze24+GgewESsED6zrHBaQ==", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQATBOlmtS7ULBAAiOldufc0GuUYVmAjITowdA==", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.519 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAWBOlmVJ18LxAAa3IAzRRrr1wnoA6st8IGyg==", 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAZBOlmUyGjMRAA0usCei49wb5QsnmdyztD/Q==", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAdBOlmYCTrFhAAMc+SF/AcrOnWfyl/r7UFqQ==", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-17T04:24:00.521 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAABOlmlR9ZAxAAdELUblUr9QUs6iP5eoCjMw==", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAABOlmmEoKCxAAy4NsGtfOnDQfNlwhB88xxw==", 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.523 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAABOlmI483BxAABYQRLW0//iWUCyOulmq3UA==", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAABOlmRoHNDhAAKzZpSJctr+VpYCv9RqPTEQ==", 2024-09-17T04:24:00.524 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lmT5vzBhAAsvSi2Wv5T0EX/m1Jqjk7Jg==", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-17T04:24:00.525 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mds", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlm5Qd4ABAAE5aFe54wDIHU0iwHDaLYWQ==", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlm+xl4ABAAySdi4J0o2jwUFshy2Y2Fvg==", 2024-09-17T04:24:00.526 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-osd", 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlmiCd4ABAA+1Sbjp58zixIbq44xztvSA==", 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlmBjV4ABAA5jW65mh/i8EIe+Vc3Z/gRg==", 2024-09-17T04:24:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlmDkZ4ABAAXzwV6cXASAlFC/EOpsZGgw==", 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAkBOlm7FN4ABAAtZEZGR/Gp+OdE5UTmsvHPw==", 2024-09-17T04:24:00.528 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lmFNltIRAAH8WlMWU//jUaR5ovDIGE6Q==", 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-17T04:24:00.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQD/A+lm9f51HBAA+JtOYZ6YXWmFDfTnreC97Q==", 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-17T04:24:00.530 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:24:00.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 msgr2=0x7fd29007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 0x7fd29007b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd298005fd0 tx=0x7fd298005850 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 msgr2=0x7fd2b014c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000c7a0 tx=0x7fd2a000cc60 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 shutdown_connections 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd290078bc0 0x7fd29007b0d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd2b0070440 0x7fd2b009c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd2b0073170 0x7fd2b014cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 --2- 172.21.15.63:0/221072611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd2b0070030 0x7fd2b014c680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 >> 172.21.15.63:0/221072611 conn(0x7fd2b00b1cb0 msgr2=0x7fd2b00acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 shutdown_connections 2024-09-17T04:24:00.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.515+0000 7fd2b504d640 1 -- 172.21.15.63:0/221072611 wait complete. 2024-09-17T04:24:00.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 -- 172.21.15.63:0/495134854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b7cc0 msgr2=0x7fd9f40d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 --2- 172.21.15.63:0/495134854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40d0980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40ce1b0 tx=0x7fd9ec02aa10 comp rx=0 tx=0).stop 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 -- 172.21.15.63:0/495134854 shutdown_connections 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 --2- 172.21.15.63:0/495134854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40d0980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 --2- 172.21.15.63:0/495134854 >> v2:172.21.15.112:3300/0 conn(0x7fd9f40cf320 0x7fd9f40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 -- 172.21.15.63:0/495134854 >> 172.21.15.63:0/495134854 conn(0x7fd9f406d4f0 msgr2=0x7fd9f4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 -- 172.21.15.63:0/495134854 shutdown_connections 2024-09-17T04:24:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.651+0000 7fd9fa990640 1 -- 172.21.15.63:0/495134854 wait complete. 2024-09-17T04:24:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.653+0000 7fd9fa990640 1 Processor -- start 2024-09-17T04:24:00.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.653+0000 7fd9fa990640 1 -- start start 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9f40cf320 0x7fd9f40b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f40d13c0 con 0x7fd9f41600b0 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f40d1240 con 0x7fd9f40b7cc0 2024-09-17T04:24:00.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9fa990640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f40d1540 con 0x7fd9f40cf320 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f8f2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f8f2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46510/0 (socket says 172.21.15.63:46510) 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f8f2d640 1 -- 172.21.15.63:0/3820997284 learned_addr learned my addr 172.21.15.63:0/3820997284 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f37fe640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9f40cf320 0x7fd9f40b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f3fff640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.654+0000 7fd9f8f2d640 1 -- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9f40cf320 msgr2=0x7fd9f40b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f8f2d640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9f40cf320 0x7fd9f40b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f8f2d640 1 -- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9f40b7cc0 msgr2=0x7fd9f40b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f8f2d640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f8f2d640 1 -- 172.21.15.63:0/3820997284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f40b5ed0 con 0x7fd9f41600b0 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f8f2d640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009d60 tx=0x7fd9ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:00.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec033050 con 0x7fd9f41600b0 2024-09-17T04:24:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9ec004550 con 0x7fd9f41600b0 2024-09-17T04:24:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec038450 con 0x7fd9f41600b0 2024-09-17T04:24:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f40b61b0 con 0x7fd9f41600b0 2024-09-17T04:24:00.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.655+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f40b6770 con 0x7fd9f41600b0 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.656+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f40b5c40 con 0x7fd9f41600b0 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.657+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9ec036070 con 0x7fd9f41600b0 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.657+0000 7fd9f0ff9640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 0x7fd9e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.657+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd9ec0bbe20 con 0x7fd9f41600b0 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.657+0000 7fd9f3fff640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 0x7fd9e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:00.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.658+0000 7fd9f3fff640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 0x7fd9e007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006fd0 tx=0x7fd9e4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:00.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.662+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9ec083f60 con 0x7fd9f41600b0 2024-09-17T04:24:00.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.919+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fd9f40d1a60 con 0x7fd9f41600b0 2024-09-17T04:24:00.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.921+0000 7fd9f0ff9640 1 -- 172.21.15.63:0/3820997284 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v13) ==== 90+0+0 (secure 0 0 0) 0x7fd9ec088990 con 0x7fd9f41600b0 2024-09-17T04:24:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 msgr2=0x7fd9e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 0x7fd9e007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4006fd0 tx=0x7fd9e4009060 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 msgr2=0x7fd9f40b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009d60 tx=0x7fd9ec003f10 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 shutdown_connections 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd9e0078b90 0x7fd9e007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd9f41600b0 0x7fd9f40b2920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd9f40cf320 0x7fd9f40b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 --2- 172.21.15.63:0/3820997284 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd9f40b7cc0 0x7fd9f40b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.924+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 >> 172.21.15.63:0/3820997284 conn(0x7fd9f406d4f0 msgr2=0x7fd9f415a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.925+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 shutdown_connections 2024-09-17T04:24:00.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:00.925+0000 7fd9fa990640 1 -- 172.21.15.63:0/3820997284 wait complete. 2024-09-17T04:24:00.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 -- 172.21.15.63:0/1195429831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 msgr2=0x7f81a80b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 --2- 172.21.15.63:0/1195429831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80b5fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f81a80ba1c0 tx=0x7f819802a560 comp rx=0 tx=0).stop 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 -- 172.21.15.63:0/1195429831 shutdown_connections 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 --2- 172.21.15.63:0/1195429831 >> v2:172.21.15.112:3300/0 conn(0x7f81a80b64e0 0x7f81a806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 --2- 172.21.15.63:0/1195429831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80b5fa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 --2- 172.21.15.63:0/1195429831 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 0x7f81a80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 -- 172.21.15.63:0/1195429831 >> 172.21.15.63:0/1195429831 conn(0x7f81a809d870 msgr2=0x7f81a80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 -- 172.21.15.63:0/1195429831 shutdown_connections 2024-09-17T04:24:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.054+0000 7f81af7ad640 1 -- 172.21.15.63:0/1195429831 wait complete. 2024-09-17T04:24:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.056+0000 7f81af7ad640 1 Processor -- start 2024-09-17T04:24:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.056+0000 7f81af7ad640 1 -- start start 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a80b64e0 0x7f81a80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 0x7f81a81f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81a806e770 con 0x7f81a81620e0 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f81a806e5f0 con 0x7f81a80b64e0 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81af7ad640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f81a806e8f0 con 0x7f81a80b9d00 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81add4a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81add4a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46532/0 (socket says 172.21.15.63:46532) 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81add4a640 1 -- 172.21.15.63:0/2749271470 learned_addr learned my addr 172.21.15.63:0/2749271470 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81ad549640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a80b64e0 0x7f81a80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.057+0000 7f81acd48640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 0x7f81a81f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 -- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 msgr2=0x7f81a81f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 0x7f81a81f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 -- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a80b64e0 msgr2=0x7f81a80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a80b64e0 0x7f81a80c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 -- 172.21.15.63:0/2749271470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a81f92a0 con 0x7f81a81620e0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81add4a640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e650 tx=0x7f81a000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a000cab0 con 0x7f81a81620e0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81a000cc50 con 0x7f81a81620e0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a815afd0 con 0x7f81a81620e0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0005020 con 0x7f81a81620e0 2024-09-17T04:24:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.058+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a81f9a90 con 0x7f81a81620e0 2024-09-17T04:24:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.059+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a80cfb40 con 0x7f81a81620e0 2024-09-17T04:24:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.060+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81a00051c0 con 0x7f81a81620e0 2024-09-17T04:24:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.061+0000 7f819dffb640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 0x7f818c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.061+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f81a009b1a0 con 0x7f81a81620e0 2024-09-17T04:24:01.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.061+0000 7f81ad549640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 0x7f818c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.061+0000 7f81ad549640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 0x7f818c07b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a4005fd0 tx=0x7f81a40094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.065+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81a00632e0 con 0x7f81a81620e0 2024-09-17T04:24:01.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.327+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f81a81f9540 con 0x7f81a81620e0 2024-09-17T04:24:01.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.329+0000 7f819dffb640 1 -- 172.21.15.63:0/2749271470 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f81a0067d10 con 0x7f81a81620e0 2024-09-17T04:24:01.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 msgr2=0x7f818c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 0x7f818c07b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81a4005fd0 tx=0x7f81a40094a0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 msgr2=0x7f81a80ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81a000e650 tx=0x7f81a000eb10 comp rx=0 tx=0).stop 2024-09-17T04:24:01.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 shutdown_connections 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f818c078b90 0x7f818c07b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81a81620e0 0x7f81a80ca320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f81a80b9d00 0x7f81a81f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 --2- 172.21.15.63:0/2749271470 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f81a80b64e0 0x7f81a80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 >> 172.21.15.63:0/2749271470 conn(0x7f81a809d870 msgr2=0x7f81a80d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 shutdown_connections 2024-09-17T04:24:01.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.333+0000 7f81af7ad640 1 -- 172.21.15.63:0/2749271470 wait complete. 2024-09-17T04:24:01.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T04:24:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 -- 172.21.15.63:0/3341875767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080ccbd0 msgr2=0x7f78080d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 --2- 172.21.15.63:0/3341875767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080ccbd0 0x7f78080d0d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77f8005fd0 tx=0x7f77f802aa90 comp rx=0 tx=0).stop 2024-09-17T04:24:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 -- 172.21.15.63:0/3341875767 shutdown_connections 2024-09-17T04:24:01.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 --2- 172.21.15.63:0/3341875767 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080d12c0 0x7f78080d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 --2- 172.21.15.63:0/3341875767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080ccbd0 0x7f78080d0d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 -- 172.21.15.63:0/3341875767 >> 172.21.15.63:0/3341875767 conn(0x7f7808072ae0 msgr2=0x7f7808072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:01.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 -- 172.21.15.63:0/3341875767 shutdown_connections 2024-09-17T04:24:01.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.461+0000 7f780ebf1640 1 -- 172.21.15.63:0/3341875767 wait complete. 2024-09-17T04:24:01.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.463+0000 7f780ebf1640 1 Processor -- start 2024-09-17T04:24:01.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.463+0000 7f780ebf1640 1 -- start start 2024-09-17T04:24:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78080b51c0 0x7f78080c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080ccbd0 0x7f7808159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78080cf280 con 0x7f78080d12c0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f78080cf100 con 0x7f78080b51c0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780ebf1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f78080cf400 con 0x7f78080ccbd0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46556/0 (socket says 172.21.15.63:46556) 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 -- 172.21.15.63:0/2895130613 learned_addr learned my addr 172.21.15.63:0/2895130613 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f7807fff640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080ccbd0 0x7f7808159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780c98d640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78080b51c0 0x7f78080c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 -- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080ccbd0 msgr2=0x7f7808159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080ccbd0 0x7f7808159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 -- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78080b51c0 msgr2=0x7f78080c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78080b51c0 0x7f78080c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 -- 172.21.15.63:0/2895130613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780815a310 con 0x7f78080d12c0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f780d18e640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77f000d630 tx=0x7f77f000daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.465+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0017070 con 0x7f78080d12c0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.466+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77f0004310 con 0x7f78080d12c0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.466+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78080c7950 con 0x7f78080d12c0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.466+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0005280 con 0x7f78080d12c0 2024-09-17T04:24:01.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.466+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78080c7f10 con 0x7f78080d12c0 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.467+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78080c76c0 con 0x7f78080d12c0 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.467+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77f0005420 con 0x7f78080d12c0 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.468+0000 7f78057fa640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 0x7f77e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.468+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f77f009abd0 con 0x7f78080d12c0 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.468+0000 7f780c98d640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 0x7f77e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.469+0000 7f780c98d640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 0x7f77e807b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7800001720 tx=0x7f7800009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.472+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77f0020020 con 0x7f78080d12c0 2024-09-17T04:24:01.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.728+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f78080cf8b0 con 0x7f78080d12c0 2024-09-17T04:24:01.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.731+0000 7f78057fa640 1 -- 172.21.15.63:0/2895130613 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v15) ==== 90+0+0 (secure 0 0 0) 0x7f77f0062d20 con 0x7f78080d12c0 2024-09-17T04:24:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 msgr2=0x7f77e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 0x7f77e807b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7800001720 tx=0x7f7800009040 comp rx=0 tx=0).stop 2024-09-17T04:24:01.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 msgr2=0x7f78080ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f77f000d630 tx=0x7f77f000daf0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 shutdown_connections 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f77e8078bc0 0x7f77e807b0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78080d12c0 0x7f78080ca050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f78080ccbd0 0x7f7808159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 --2- 172.21.15.63:0/2895130613 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f78080b51c0 0x7f78080c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 >> 172.21.15.63:0/2895130613 conn(0x7f7808072ae0 msgr2=0x7f78080b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 shutdown_connections 2024-09-17T04:24:01.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.733+0000 7f780ebf1640 1 -- 172.21.15.63:0/2895130613 wait complete. 2024-09-17T04:24:01.745 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T04:24:01.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.862+0000 7faf80e0e640 1 -- 172.21.15.63:0/1434455814 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 msgr2=0x7faf7c0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.862+0000 7faf80e0e640 1 --2- 172.21.15.63:0/1434455814 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c0702d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf70005fd0 tx=0x7faf7002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 -- 172.21.15.63:0/1434455814 shutdown_connections 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 --2- 172.21.15.63:0/1434455814 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c0702d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 --2- 172.21.15.63:0/1434455814 >> v2:172.21.15.112:3300/0 conn(0x7faf7c0b4090 0x7faf7c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 -- 172.21.15.63:0/1434455814 >> 172.21.15.63:0/1434455814 conn(0x7faf7c0cdcc0 msgr2=0x7faf7c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 -- 172.21.15.63:0/1434455814 shutdown_connections 2024-09-17T04:24:01.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.863+0000 7faf80e0e640 1 -- 172.21.15.63:0/1434455814 wait complete. 2024-09-17T04:24:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.865+0000 7faf80e0e640 1 Processor -- start 2024-09-17T04:24:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.865+0000 7faf80e0e640 1 -- start start 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c1f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 0x7faf7c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c0b4a30 con 0x7faf7c0b4090 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c0b48b0 con 0x7faf7c0cfeb0 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf80e0e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c0b4bb0 con 0x7faf7c06fec0 2024-09-17T04:24:01.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46572/0 (socket says 172.21.15.63:46572) 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 -- 172.21.15.63:0/4248531672 learned_addr learned my addr 172.21.15.63:0/4248531672 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf7a59c640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c1f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf7ad9d640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 0x7faf7c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 -- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 msgr2=0x7faf7c1f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c1f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 -- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 msgr2=0x7faf7c149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.866+0000 7faf79d9b640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 0x7faf7c149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf79d9b640 1 -- 172.21.15.63:0/4248531672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c1f78e0 con 0x7faf7c0b4090 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf7a59c640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c1f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf7ad9d640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 0x7faf7c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf79d9b640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf70000c00 tx=0x7faf700035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7003e030 con 0x7faf7c0b4090 2024-09-17T04:24:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf70003ae0 con 0x7faf7c0b4090 2024-09-17T04:24:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c1f7bc0 con 0x7faf7c0b4090 2024-09-17T04:24:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf70035040 con 0x7faf7c0b4090 2024-09-17T04:24:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.867+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c14ba00 con 0x7faf7c0b4090 2024-09-17T04:24:01.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.868+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c0b50d0 con 0x7faf7c0b4090 2024-09-17T04:24:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.869+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf70041030 con 0x7faf7c0b4090 2024-09-17T04:24:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.869+0000 7faf6affd640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 0x7faf5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.870+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7faf700baea0 con 0x7faf7c0b4090 2024-09-17T04:24:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.870+0000 7faf7a59c640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 0x7faf5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:01.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.870+0000 7faf7a59c640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 0x7faf5c07b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009ab0 tx=0x7faf6c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:01.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:01.874+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf700836c0 con 0x7faf7c0b4090 2024-09-17T04:24:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.130+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7faf7c1f7670 con 0x7faf7c0b4090 2024-09-17T04:24:02.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.132+0000 7faf6affd640 1 -- 172.21.15.63:0/4248531672 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v16) ==== 90+0+0 (secure 0 0 0) 0x7faf70082fc0 con 0x7faf7c0b4090 2024-09-17T04:24:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.134+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 msgr2=0x7faf5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.134+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 0x7faf5c07b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009ab0 tx=0x7faf6c005f90 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.134+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 msgr2=0x7faf7c14bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.134+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf70000c00 tx=0x7faf700035f0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 shutdown_connections 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faf5c078bc0 0x7faf5c07b0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faf7c0cfeb0 0x7faf7c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf7c0b4090 0x7faf7c14bf20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 --2- 172.21.15.63:0/4248531672 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faf7c06fec0 0x7faf7c1f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 >> 172.21.15.63:0/4248531672 conn(0x7faf7c0cdcc0 msgr2=0x7faf7c15e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 shutdown_connections 2024-09-17T04:24:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.135+0000 7faf80e0e640 1 -- 172.21.15.63:0/4248531672 wait complete. 2024-09-17T04:24:02.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T04:24:02.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 -- 172.21.15.63:0/2798569579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0074420 msgr2=0x7fa6e006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2798569579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0074420 0x7fa6e006fe30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8005fd0 tx=0x7fa6d802a5d0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 -- 172.21.15.63:0/2798569579 shutdown_connections 2024-09-17T04:24:02.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2798569579 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e015c580 0x7fa6e0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2798569579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0074420 0x7fa6e006fe30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 -- 172.21.15.63:0/2798569579 >> 172.21.15.63:0/2798569579 conn(0x7fa6e006def0 msgr2=0x7fa6e006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:02.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 -- 172.21.15.63:0/2798569579 shutdown_connections 2024-09-17T04:24:02.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.263+0000 7fa6e817b640 1 -- 172.21.15.63:0/2798569579 wait complete. 2024-09-17T04:24:02.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.265+0000 7fa6e817b640 1 Processor -- start 2024-09-17T04:24:02.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.265+0000 7fa6e817b640 1 -- start start 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6e0074420 0x7fa6e01f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e0155ce0 0x7fa6e00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e015f850 con 0x7fa6e0151d10 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0070ba0 con 0x7fa6e0074420 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e817b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e015f9d0 con 0x7fa6e0155ce0 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e6718640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e6718640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46592/0 (socket says 172.21.15.63:46592) 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e6718640 1 -- 172.21.15.63:0/2343835951 learned_addr learned my addr 172.21.15.63:0/2343835951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e5f17640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6e0074420 0x7fa6e01f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.266+0000 7fa6e5716640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e0155ce0 0x7fa6e00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 -- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e0155ce0 msgr2=0x7fa6e00cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e0155ce0 0x7fa6e00cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 -- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6e0074420 msgr2=0x7fa6e01f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6e0074420 0x7fa6e01f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 -- 172.21.15.63:0/2343835951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e00ccf60 con 0x7fa6e0151d10 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e6718640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0002230 tx=0x7fa6d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003b70 con 0x7fa6e0151d10 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d0003d10 con 0x7fa6e0151d10 2024-09-17T04:24:02.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e00c6680 con 0x7fa6e0151d10 2024-09-17T04:24:02.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0005330 con 0x7fa6e0151d10 2024-09-17T04:24:02.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.267+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e01f64e0 con 0x7fa6e0151d10 2024-09-17T04:24:02.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.268+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e01f6bf0 con 0x7fa6e0151d10 2024-09-17T04:24:02.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.269+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6d00056e0 con 0x7fa6e0151d10 2024-09-17T04:24:02.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.269+0000 7fa6de7fc640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.269+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fa6d009a810 con 0x7fa6e0151d10 2024-09-17T04:24:02.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.269+0000 7fa6e5f17640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.270+0000 7fa6e5f17640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8033000 tx=0x7fa6d8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:02.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.274+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6d00629e0 con 0x7fa6e0151d10 2024-09-17T04:24:02.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.536+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fa6e015fef0 con 0x7fa6e0151d10 2024-09-17T04:24:02.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.538+0000 7fa6de7fc640 1 -- 172.21.15.63:0/2343835951 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v17) ==== 97+0+0 (secure 0 0 0) 0x7fa6d0067410 con 0x7fa6e0151d10 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 msgr2=0x7fa6cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8033000 tx=0x7fa6d8004730 comp rx=0 tx=0).stop 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 msgr2=0x7fa6e01595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0002230 tx=0x7fa6d000cb90 comp rx=0 tx=0).stop 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 shutdown_connections 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6e0151d10 0x7fa6e01595a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa6e0155ce0 0x7fa6e00cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 --2- 172.21.15.63:0/2343835951 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa6e0074420 0x7fa6e01f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 >> 172.21.15.63:0/2343835951 conn(0x7fa6e006def0 msgr2=0x7fa6e015ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:02.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 shutdown_connections 2024-09-17T04:24:02.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.541+0000 7fa6e817b640 1 -- 172.21.15.63:0/2343835951 wait complete. 2024-09-17T04:24:02.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T04:24:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 -- 172.21.15.63:0/1448064074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 msgr2=0x7f6c5415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 --2- 172.21.15.63:0/1448064074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c5415c6e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c44005fd0 tx=0x7f6c4402a8b0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 -- 172.21.15.63:0/1448064074 shutdown_connections 2024-09-17T04:24:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 --2- 172.21.15.63:0/1448064074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c5415c6e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 -- 172.21.15.63:0/1448064074 >> 172.21.15.63:0/1448064074 conn(0x7f6c54072ae0 msgr2=0x7f6c54072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 -- 172.21.15.63:0/1448064074 shutdown_connections 2024-09-17T04:24:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.669+0000 7f6c58db0640 1 -- 172.21.15.63:0/1448064074 wait complete. 2024-09-17T04:24:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.671+0000 7f6c58db0640 1 Processor -- start 2024-09-17T04:24:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.671+0000 7f6c58db0640 1 -- start start 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c540ccbd0 0x7f6c5415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 0x7f6c541f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540cf480 con 0x7f6c540b51c0 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540cf300 con 0x7f6c540d1490 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6c540cf600 con 0x7f6c540ccbd0 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46602/0 (socket says 172.21.15.63:46602) 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 -- 172.21.15.63:0/505209505 learned_addr learned my addr 172.21.15.63:0/505209505 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c52d9d640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 0x7f6c541f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c51d9b640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c540ccbd0 0x7f6c5415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 -- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c540ccbd0 msgr2=0x7f6c5415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c540ccbd0 0x7f6c5415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 -- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 msgr2=0x7f6c541f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 0x7f6c541f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 -- 172.21.15.63:0/505209505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c540ca9f0 con 0x7f6c540b51c0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c52d9d640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 0x7f6c541f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c5259c640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009cd0 tx=0x7f6c44003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44031b90 con 0x7f6c540b51c0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c44031e20 con 0x7f6c540b51c0 2024-09-17T04:24:02.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c540cacd0 con 0x7f6c540b51c0 2024-09-17T04:24:02.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.673+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c440332d0 con 0x7f6c540b51c0 2024-09-17T04:24:02.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.674+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c540cb290 con 0x7f6c540b51c0 2024-09-17T04:24:02.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.674+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c540cd350 con 0x7f6c540b51c0 2024-09-17T04:24:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.675+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c44033470 con 0x7f6c540b51c0 2024-09-17T04:24:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.676+0000 7f6c4affd640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 0x7f6c3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.676+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f6c440bc020 con 0x7f6c540b51c0 2024-09-17T04:24:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.676+0000 7f6c51d9b640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 0x7f6c3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:02.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.677+0000 7f6c51d9b640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 0x7f6c3407b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007fd0 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:02.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.680+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6c4403f030 con 0x7f6c540b51c0 2024-09-17T04:24:02.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.937+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f6c540cfad0 con 0x7f6c540b51c0 2024-09-17T04:24:02.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.939+0000 7f6c4affd640 1 -- 172.21.15.63:0/505209505 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v18) ==== 90+0+0 (secure 0 0 0) 0x7f6c440841f0 con 0x7f6c540b51c0 2024-09-17T04:24:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 msgr2=0x7f6c3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 0x7f6c3407b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007fd0 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2024-09-17T04:24:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 msgr2=0x7f6c540a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:02.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009cd0 tx=0x7f6c44003a10 comp rx=0 tx=0).stop 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 shutdown_connections 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6c34078b90 0x7f6c3407b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6c540d1490 0x7f6c541f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6c540ccbd0 0x7f6c5415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 --2- 172.21.15.63:0/505209505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c540b51c0 0x7f6c540a9cb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 >> 172.21.15.63:0/505209505 conn(0x7f6c54072ae0 msgr2=0x7f6c540d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 shutdown_connections 2024-09-17T04:24:02.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:02.942+0000 7f6c58db0640 1 -- 172.21.15.63:0/505209505 wait complete. 2024-09-17T04:24:02.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 -- 172.21.15.63:0/1222163857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 msgr2=0x7fac0006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 --2- 172.21.15.63:0/1222163857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0006e4f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005fd0 tx=0x7fabf802aa00 comp rx=0 tx=0).stop 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 -- 172.21.15.63:0/1222163857 shutdown_connections 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 --2- 172.21.15.63:0/1222163857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0006e4f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 --2- 172.21.15.63:0/1222163857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b9970 0x7fac000b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 -- 172.21.15.63:0/1222163857 >> 172.21.15.63:0/1222163857 conn(0x7fac0009d7f0 msgr2=0x7fac000d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 -- 172.21.15.63:0/1222163857 shutdown_connections 2024-09-17T04:24:03.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.070+0000 7fac07615640 1 -- 172.21.15.63:0/1222163857 wait complete. 2024-09-17T04:24:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.072+0000 7fac07615640 1 Processor -- start 2024-09-17T04:24:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.072+0000 7fac07615640 1 -- start start 2024-09-17T04:24:03.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.073+0000 7fac07615640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.073+0000 7fac07615640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 0x7fac001f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac07615640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 0x7fac000c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac07615640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fac0006ea30 con 0x7fac0006e0e0 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac07615640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fac000d5050 con 0x7fac000b9970 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac07615640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fac0006ebb0 con 0x7fac000b5fa0 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46628/0 (socket says 172.21.15.63:46628) 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 -- 172.21.15.63:0/784121461 learned_addr learned my addr 172.21.15.63:0/784121461 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac04bb0640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 0x7fac001f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac05bb2640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 0x7fac000c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 -- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 msgr2=0x7fac001f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 0x7fac001f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 -- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 msgr2=0x7fac000c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 0x7fac000c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 -- 172.21.15.63:0/784121461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac000c8630 con 0x7fac0006e0e0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac04bb0640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 0x7fac001f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac05bb2640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 0x7fac000c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac053b1640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c970 tx=0x7fabf000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0007bb0 con 0x7fac0006e0e0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf0007e40 con 0x7fac0006e0e0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac000c8910 con 0x7fac0006e0e0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.074+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf0005290 con 0x7fac0006e0e0 2024-09-17T04:24:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.075+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac000c8ed0 con 0x7fac0006e0e0 2024-09-17T04:24:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.076+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0006f080 con 0x7fac0006e0e0 2024-09-17T04:24:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.076+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fabf0005430 con 0x7fac0006e0e0 2024-09-17T04:24:03.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.077+0000 7fabfdffb640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 0x7fabec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.077+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fabf009af80 con 0x7fac0006e0e0 2024-09-17T04:24:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.077+0000 7fac04bb0640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 0x7fabec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.078+0000 7fac04bb0640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 0x7fabec07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006fd0 tx=0x7fabf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:03.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.081+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabf0014070 con 0x7fac0006e0e0 2024-09-17T04:24:03.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.270+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fac000b2da0 con 0x7fac0006e0e0 2024-09-17T04:24:03.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.271+0000 7fabfdffb640 1 -- 172.21.15.63:0/784121461 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fabf0063710 con 0x7fac0006e0e0 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-17T04:24:03.271 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-17T04:24:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 msgr2=0x7fabec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 0x7fabec07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fabf4006fd0 tx=0x7fabf4008040 comp rx=0 tx=0).stop 2024-09-17T04:24:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 msgr2=0x7fac0015c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c970 tx=0x7fabf000ce30 comp rx=0 tx=0).stop 2024-09-17T04:24:03.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 shutdown_connections 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fabec078b90 0x7fabec07b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fac000b9970 0x7fac000c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fac000b5fa0 0x7fac001f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 --2- 172.21.15.63:0/784121461 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0006e0e0 0x7fac0015c970 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 >> 172.21.15.63:0/784121461 conn(0x7fac0009d7f0 msgr2=0x7fac0015e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 shutdown_connections 2024-09-17T04:24:03.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.273+0000 7fac07615640 1 -- 172.21.15.63:0/784121461 wait complete. 2024-09-17T04:24:03.284 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T04:24:03.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 -- 172.21.15.63:0/2577899224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de4162190 msgr2=0x7f4de40d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 --2- 172.21.15.63:0/2577899224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de4162190 0x7f4de40d13d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009830 tx=0x7f4dd002a480 comp rx=0 tx=0).stop 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 -- 172.21.15.63:0/2577899224 shutdown_connections 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 --2- 172.21.15.63:0/2577899224 >> v2:172.21.15.112:3300/0 conn(0x7f4de40cf300 0x7f4de40cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 --2- 172.21.15.63:0/2577899224 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de4162190 0x7f4de40d13d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 -- 172.21.15.63:0/2577899224 >> 172.21.15.63:0/2577899224 conn(0x7f4de409d7c0 msgr2=0x7f4de408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 -- 172.21.15.63:0/2577899224 shutdown_connections 2024-09-17T04:24:03.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.406+0000 7f4deae20640 1 -- 172.21.15.63:0/2577899224 wait complete. 2024-09-17T04:24:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.408+0000 7f4deae20640 1 Processor -- start 2024-09-17T04:24:03.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.408+0000 7f4deae20640 1 -- start start 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de40cf300 0x7f4de41f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4de4162190 0x7f4de415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40cfc50 con 0x7f4de40b32a0 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4de40d1a30 con 0x7f4de4162190 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4deae20640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4de40cfdd0 con 0x7f4de40cf300 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4de8bbc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4de8bbc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46640/0 (socket says 172.21.15.63:46640) 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4de8bbc640 1 -- 172.21.15.63:0/1645801092 learned_addr learned my addr 172.21.15.63:0/1645801092 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4de93bd640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4de4162190 0x7f4de415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.409+0000 7f4de3fff640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de40cf300 0x7f4de41f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 -- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de40cf300 msgr2=0x7f4de41f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de40cf300 0x7f4de41f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 -- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4de4162190 msgr2=0x7f4de415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4de4162190 0x7f4de415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 -- 172.21.15.63:0/1645801092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de41f9cc0 con 0x7f4de40b32a0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de8bbc640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c430 tx=0x7f4dd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011790 con 0x7f4de40b32a0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dd8017070 con 0x7f4de40b32a0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de40b4d40 con 0x7f4de40b32a0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011ce0 con 0x7f4de40b32a0 2024-09-17T04:24:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.410+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de41f5890 con 0x7f4de40b32a0 2024-09-17T04:24:03.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.411+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de41614e0 con 0x7f4de40b32a0 2024-09-17T04:24:03.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.412+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4dd801c460 con 0x7f4de40b32a0 2024-09-17T04:24:03.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.412+0000 7f4de17fa640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 0x7f4dc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:03.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.413+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f4dd809a5d0 con 0x7f4de40b32a0 2024-09-17T04:24:03.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.413+0000 7f4de3fff640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 0x7f4dc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:03.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.413+0000 7f4de3fff640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 0x7f4dc807b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0034000 tx=0x7f4dd0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:03.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.417+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4de41614e0 con 0x7f4de40b32a0 2024-09-17T04:24:03.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:03.603+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4de415f2b0 con 0x7f4de40b32a0 2024-09-17T04:24:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.142+0000 7f4de17fa640 1 -- 172.21.15.63:0/1645801092 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f4de41f9cc0 con 0x7f4de40b32a0 2024-09-17T04:24:04.142 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 msgr2=0x7f4dc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 0x7f4dc807b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0034000 tx=0x7f4dd0004730 comp rx=0 tx=0).stop 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 msgr2=0x7f4de41f6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c430 tx=0x7f4dd800c8f0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 shutdown_connections 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4dc8078bc0 0x7f4dc807b0d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4de4162190 0x7f4de415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4de40cf300 0x7f4de41f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 --2- 172.21.15.63:0/1645801092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4de40b32a0 0x7f4de41f6370 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 >> 172.21.15.63:0/1645801092 conn(0x7f4de409d7c0 msgr2=0x7f4de40d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 shutdown_connections 2024-09-17T04:24:04.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.145+0000 7f4deae20640 1 -- 172.21.15.63:0/1645801092 wait complete. 2024-09-17T04:24:04.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 -- 172.21.15.63:0/481707135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00b3540 msgr2=0x7f62c00d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 --2- 172.21.15.63:0/481707135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00b3540 0x7f62c00d3330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009830 tx=0x7f62b002a480 comp rx=0 tx=0).stop 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 -- 172.21.15.63:0/481707135 shutdown_connections 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 --2- 172.21.15.63:0/481707135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00b3540 0x7f62c00d3330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 -- 172.21.15.63:0/481707135 >> 172.21.15.63:0/481707135 conn(0x7f62c008bfc0 msgr2=0x7f62c009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 -- 172.21.15.63:0/481707135 shutdown_connections 2024-09-17T04:24:04.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.292+0000 7f62c7139640 1 -- 172.21.15.63:0/481707135 wait complete. 2024-09-17T04:24:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.294+0000 7f62c7139640 1 Processor -- start 2024-09-17T04:24:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.294+0000 7f62c7139640 1 -- start start 2024-09-17T04:24:04.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62c00b3540 0x7f62c0154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 0x7f62c01f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d1070 con 0x7f62c00d3870 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d0ef0 con 0x7f62c00b3540 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c7139640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f62c00d11f0 con 0x7f62c00ca8f0 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46646/0 (socket says 172.21.15.63:46646) 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 -- 172.21.15.63:0/208176051 learned_addr learned my addr 172.21.15.63:0/208176051 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c4ed5640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62c00b3540 0x7f62c0154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c56d6640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 0x7f62c01f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 -- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 msgr2=0x7f62c01f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 0x7f62c01f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 -- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62c00b3540 msgr2=0x7f62c0154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62c00b3540 0x7f62c0154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 -- 172.21.15.63:0/208176051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c00a21f0 con 0x7f62c00d3870 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62c56d6640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 0x7f62c01f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.296+0000 7f62bffff640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62b002aa70 tx=0x7f62b0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.297+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0005c90 con 0x7f62c00d3870 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.297+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62b0031e50 con 0x7f62c00d3870 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.297+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c00c9850 con 0x7f62c00d3870 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.297+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0005260 con 0x7f62c00d3870 2024-09-17T04:24:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.297+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c00c9e10 con 0x7f62c00d3870 2024-09-17T04:24:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.298+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c006e170 con 0x7f62c00d3870 2024-09-17T04:24:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.299+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f62b0005400 con 0x7f62c00d3870 2024-09-17T04:24:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.299+0000 7f62bd7fa640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 0x7f62a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.299+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f62b00bbf80 con 0x7f62c00d3870 2024-09-17T04:24:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.300+0000 7f62c4ed5640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 0x7f62a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.300+0000 7f62c4ed5640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 0x7f62a007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62a8006fd0 tx=0x7f62a8009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.303+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f62b003f030 con 0x7f62c00d3870 2024-09-17T04:24:04.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:04.491+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f62c00c95e0 con 0x7f62c00d3870 2024-09-17T04:24:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.150+0000 7f62bd7fa640 1 -- 172.21.15.63:0/208176051 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f62b0084030 con 0x7f62c00d3870 2024-09-17T04:24:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-17T04:24:05.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 msgr2=0x7f62a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 0x7f62a007b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62a8006fd0 tx=0x7f62a8009060 comp rx=0 tx=0).stop 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 msgr2=0x7f62c00a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f62b002aa70 tx=0x7f62b0033c20 comp rx=0 tx=0).stop 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 shutdown_connections 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f62a0078b90 0x7f62a007b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f62c00ca8f0 0x7f62c01f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62c00d3870 0x7f62c00a1cb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 --2- 172.21.15.63:0/208176051 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f62c00b3540 0x7f62c0154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 >> 172.21.15.63:0/208176051 conn(0x7f62c008bfc0 msgr2=0x7f62c00b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 shutdown_connections 2024-09-17T04:24:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.153+0000 7f62c7139640 1 -- 172.21.15.63:0/208176051 wait complete. 2024-09-17T04:24:05.175 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T04:24:05.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 -- 172.21.15.63:0/3702053678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe00caee0 msgr2=0x7f9fe006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:05.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/3702053678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe00caee0 0x7f9fe006ee90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009900 tx=0x7f9fd802a610 comp rx=0 tx=0).stop 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 -- 172.21.15.63:0/3702053678 shutdown_connections 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/3702053678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe00caee0 0x7f9fe006ee90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/3702053678 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe015bf20 0x7f9fe00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 -- 172.21.15.63:0/3702053678 >> 172.21.15.63:0/3702053678 conn(0x7f9fe00b1cb0 msgr2=0x7f9fe00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 -- 172.21.15.63:0/3702053678 shutdown_connections 2024-09-17T04:24:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.299+0000 7f9fe4be4640 1 -- 172.21.15.63:0/3702053678 wait complete. 2024-09-17T04:24:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.301+0000 7f9fe4be4640 1 Processor -- start 2024-09-17T04:24:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.301+0000 7f9fe4be4640 1 -- start start 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fe00caee0 0x7f9fe009cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe00cfb00 0x7f9fe00c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe015b310 con 0x7f9fe015bf20 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe015b190 con 0x7f9fe00caee0 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fe4be4640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe00ccba0 con 0x7f9fe00cfb00 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46662/0 (socket says 172.21.15.63:46662) 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 -- 172.21.15.63:0/2418230878 learned_addr learned my addr 172.21.15.63:0/2418230878 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fddd9b640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe00cfb00 0x7f9fe00c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fde59c640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fe00caee0 0x7f9fe009cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 -- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe00cfb00 msgr2=0x7f9fe00c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe00cfb00 0x7f9fe00c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 -- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fe00caee0 msgr2=0x7f9fe009cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fe00caee0 0x7f9fe009cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 -- 172.21.15.63:0/2418230878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe00c6cb0 con 0x7f9fe015bf20 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.303+0000 7f9fded9d640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009230 tx=0x7f9fd80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.304+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd803e030 con 0x7f9fe015bf20 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.304+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fd8003ca0 con 0x7f9fe015bf20 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.304+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe00c9830 con 0x7f9fe015bf20 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.304+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8035040 con 0x7f9fe015bf20 2024-09-17T04:24:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.304+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe00c9df0 con 0x7f9fe015bf20 2024-09-17T04:24:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.305+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe00cd0f0 con 0x7f9fe015bf20 2024-09-17T04:24:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.306+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fd8041030 con 0x7f9fe015bf20 2024-09-17T04:24:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.306+0000 7f9fd6ffd640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.306+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f9fd80bb070 con 0x7f9fe015bf20 2024-09-17T04:24:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.307+0000 7f9fde59c640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.307+0000 7f9fde59c640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 0x7f9fc007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00c3c20 tx=0x7f9fd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:05.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.311+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fd8082fe0 con 0x7f9fe015bf20 2024-09-17T04:24:05.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:05.536+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9fe00ad270 con 0x7f9fe015bf20 2024-09-17T04:24:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.151+0000 7f9fd6ffd640 1 -- 172.21.15.63:0/2418230878 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f9fd8087a10 con 0x7f9fe015bf20 2024-09-17T04:24:06.151 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T04:24:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 msgr2=0x7f9fc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 0x7f9fc007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00c3c20 tx=0x7f9fd0009040 comp rx=0 tx=0).stop 2024-09-17T04:24:06.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 msgr2=0x7f9fe00c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009230 tx=0x7f9fd80038a0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 shutdown_connections 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9fe015bf20 0x7f9fe00c5110 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9fe00cfb00 0x7f9fe00c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 --2- 172.21.15.63:0/2418230878 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9fe00caee0 0x7f9fe009cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.155+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 >> 172.21.15.63:0/2418230878 conn(0x7f9fe00b1cb0 msgr2=0x7f9fe00b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.156+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 shutdown_connections 2024-09-17T04:24:06.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.156+0000 7f9fe4be4640 1 -- 172.21.15.63:0/2418230878 wait complete. 2024-09-17T04:24:06.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:24:06.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 -- 172.21.15.63:0/2001038214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60b00039e0 msgr2=0x7f60b0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 --2- 172.21.15.63:0/2001038214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60b00039e0 0x7f60b0003e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0017c0 tx=0x7f60b0005830 comp rx=0 tx=0).stop 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c37fe640 1 -- 172.21.15.63:0/2001038214 reap_dead start 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 -- 172.21.15.63:0/2001038214 shutdown_connections 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 -- 172.21.15.63:0/2001038214 >> 172.21.15.63:0/2001038214 conn(0x7f60c406def0 msgr2=0x7f60c406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 -- 172.21.15.63:0/2001038214 shutdown_connections 2024-09-17T04:24:06.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.310+0000 7f60c9464640 1 -- 172.21.15.63:0/2001038214 wait complete. 2024-09-17T04:24:06.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.312+0000 7f60c9464640 1 Processor -- start 2024-09-17T04:24:06.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.312+0000 7f60c9464640 1 -- start start 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60b00039e0 0x7f60c4142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c41445a0 0x7f60c415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4070b50 con 0x7f60c41f69c0 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40709d0 con 0x7f60c41445a0 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c9464640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f60c40b4cb0 con 0x7f60b00039e0 2024-09-17T04:24:06.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46682/0 (socket says 172.21.15.63:46682) 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 -- 172.21.15.63:0/2319205069 learned_addr learned my addr 172.21.15.63:0/2319205069 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c2ffd640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60b00039e0 0x7f60c4142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c37fe640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c41445a0 0x7f60c415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 -- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60b00039e0 msgr2=0x7f60c4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60b00039e0 0x7f60c4142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 -- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c41445a0 msgr2=0x7f60c415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c41445a0 0x7f60c415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 -- 172.21.15.63:0/2319205069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c4142580 con 0x7f60c41f69c0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60c27fc640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011a10 tx=0x7f60ac011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac01e070 con 0x7f60c41f69c0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.314+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60ac00fd60 con 0x7f60c41f69c0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.315+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c4144bf0 con 0x7f60c41f69c0 2024-09-17T04:24:06.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.315+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac019650 con 0x7f60c41f69c0 2024-09-17T04:24:06.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.315+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c41451b0 con 0x7f60c41f69c0 2024-09-17T04:24:06.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.315+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c406fe30 con 0x7f60c41f69c0 2024-09-17T04:24:06.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.316+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60ac021070 con 0x7f60c41f69c0 2024-09-17T04:24:06.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.317+0000 7f60bb7fe640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 0x7f60a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.317+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f60ac09b5f0 con 0x7f60c41f69c0 2024-09-17T04:24:06.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.317+0000 7f60c2ffd640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 0x7f60a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.318+0000 7f60c2ffd640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 0x7f60a407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60bc032000 tx=0x7f60bc02c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.322+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60ac063470 con 0x7f60c41f69c0 2024-09-17T04:24:06.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.505+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60c40b0ae0 con 0x7f60c41f69c0 2024-09-17T04:24:06.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.506+0000 7f60bb7fe640 1 -- 172.21.15.63:0/2319205069 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16718 (secure 0 0 0) 0x7f60ac067ea0 con 0x7f60c41f69c0 2024-09-17T04:24:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:06.506 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":31,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:24:05.537666+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:24:03.608048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T04:24:04.496167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:24:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 msgr2=0x7f60a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 0x7f60a407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60bc032000 tx=0x7f60bc02c000 comp rx=0 tx=0).stop 2024-09-17T04:24:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 msgr2=0x7f60c4144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f60ac011a10 tx=0x7f60ac011ed0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 shutdown_connections 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f60a4078b90 0x7f60a407b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f60c41445a0 0x7f60c415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60c41f69c0 0x7f60c4144060 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 --2- 172.21.15.63:0/2319205069 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f60b00039e0 0x7f60c4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 >> 172.21.15.63:0/2319205069 conn(0x7f60c406def0 msgr2=0x7f60c40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 shutdown_connections 2024-09-17T04:24:06.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.508+0000 7f60c9464640 1 -- 172.21.15.63:0/2319205069 wait complete. 2024-09-17T04:24:06.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:24:06.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 -- 172.21.15.63:0/4026392214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 msgr2=0x7f0cac0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/4026392214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac0b39c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0b4f90 tx=0x7f0ca802a530 comp rx=0 tx=0).stop 2024-09-17T04:24:06.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 -- 172.21.15.63:0/4026392214 shutdown_connections 2024-09-17T04:24:06.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/4026392214 >> v2:172.21.15.112:3300/0 conn(0x7f0cac0cd3e0 0x7f0cac070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/4026392214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac0b39c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 -- 172.21.15.63:0/4026392214 >> 172.21.15.63:0/4026392214 conn(0x7f0cac06d7d0 msgr2=0x7f0cac0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 -- 172.21.15.63:0/4026392214 shutdown_connections 2024-09-17T04:24:06.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.637+0000 7f0cb36dc640 1 -- 172.21.15.63:0/4026392214 wait complete. 2024-09-17T04:24:06.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.639+0000 7f0cb36dc640 1 Processor -- start 2024-09-17T04:24:06.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.639+0000 7f0cb36dc640 1 -- start start 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 0x7f0cac1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 0x7f0cac146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac073b00 con 0x7f0cac0af780 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac073980 con 0x7f0cac0706c0 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.640+0000 7f0cb36dc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac073c80 con 0x7f0cac0cd3e0 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46706/0 (socket says 172.21.15.63:46706) 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 -- 172.21.15.63:0/3981017913 learned_addr learned my addr 172.21.15.63:0/3981017913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb1c79640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 0x7f0cac146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb1478640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 0x7f0cac1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 -- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 msgr2=0x7f0cac146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 0x7f0cac146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 -- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 msgr2=0x7f0cac1466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 0x7f0cac1466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 -- 172.21.15.63:0/3981017913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac15b700 con 0x7f0cac0af780 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb1478640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 0x7f0cac1466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb1c79640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 0x7f0cac146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb0c77640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009fd0 tx=0x7f0c9c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00ccc0 con 0x7f0cac0af780 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c9c00ee70 con 0x7f0cac0af780 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac15b9e0 con 0x7f0cac0af780 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.641+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00ce60 con 0x7f0cac0af780 2024-09-17T04:24:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.642+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac15bfa0 con 0x7f0cac0af780 2024-09-17T04:24:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.643+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac0b39c0 con 0x7f0cac0af780 2024-09-17T04:24:06.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.643+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c9c004280 con 0x7f0cac0af780 2024-09-17T04:24:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.644+0000 7f0ca1ffb640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 0x7f0c9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.644+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0c9c09b620 con 0x7f0cac0af780 2024-09-17T04:24:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.644+0000 7f0cb1478640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 0x7f0c9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.645+0000 7f0cb1478640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 0x7f0c9007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.648+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c9c063b80 con 0x7f0cac0af780 2024-09-17T04:24:06.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.835+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cac0cc570 con 0x7f0cac0af780 2024-09-17T04:24:06.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.836+0000 7f0ca1ffb640 1 -- 172.21.15.63:0/3981017913 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16718 (secure 0 0 0) 0x7f0c9c063480 con 0x7f0cac0af780 2024-09-17T04:24:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:06.836 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":31,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:24:05.537666+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:24:03.608048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T04:24:04.496167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:24:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 msgr2=0x7f0c9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 0x7f0c9007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca8004730 comp rx=0 tx=0).stop 2024-09-17T04:24:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 msgr2=0x7f0cac1f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009fd0 tx=0x7f0c9c00ec20 comp rx=0 tx=0).stop 2024-09-17T04:24:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 shutdown_connections 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0c90078b90 0x7f0c9007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0cac0cd3e0 0x7f0cac146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cac0af780 0x7f0cac1f3f90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 --2- 172.21.15.63:0/3981017913 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0cac0706c0 0x7f0cac1466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 >> 172.21.15.63:0/3981017913 conn(0x7f0cac06d7d0 msgr2=0x7f0cac0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 shutdown_connections 2024-09-17T04:24:06.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.838+0000 7f0cb36dc640 1 -- 172.21.15.63:0/3981017913 wait complete. 2024-09-17T04:24:06.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T04:24:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 -- 172.21.15.63:0/2006649005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2006e170 msgr2=0x7f9a200b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 --2- 172.21.15.63:0/2006649005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2006e170 0x7f9a200b3540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009830 tx=0x7f9a1002a530 comp rx=0 tx=0).stop 2024-09-17T04:24:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 -- 172.21.15.63:0/2006649005 shutdown_connections 2024-09-17T04:24:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 --2- 172.21.15.63:0/2006649005 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a2006e170 0x7f9a200b3540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 -- 172.21.15.63:0/2006649005 >> 172.21.15.63:0/2006649005 conn(0x7f9a2008bfc0 msgr2=0x7f9a2009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:06.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 -- 172.21.15.63:0/2006649005 shutdown_connections 2024-09-17T04:24:06.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.970+0000 7f9a26663640 1 -- 172.21.15.63:0/2006649005 wait complete. 2024-09-17T04:24:06.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.972+0000 7f9a26663640 1 Processor -- start 2024-09-17T04:24:06.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.972+0000 7f9a26663640 1 -- start start 2024-09-17T04:24:06.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2006f4b0 0x7f9a200cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a200ceb40 0x7f9a2015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9a200d1070 con 0x7f9a201f8720 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9a200d0ef0 con 0x7f9a200ceb40 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a26663640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9a200d11f0 con 0x7f9a2006f4b0 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a24c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a24c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46728/0 (socket says 172.21.15.63:46728) 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.973+0000 7f9a24c00640 1 -- 172.21.15.63:0/2480171703 learned_addr learned my addr 172.21.15.63:0/2480171703 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a1ffff640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2006f4b0 0x7f9a200cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a1f7fe640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a200ceb40 0x7f9a2015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 -- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2006f4b0 msgr2=0x7f9a200cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2006f4b0 0x7f9a200cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 -- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a200ceb40 msgr2=0x7f9a2015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a200ceb40 0x7f9a2015fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 -- 172.21.15.63:0/2480171703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201f9070 con 0x7f9a201f8720 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a24c00640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c730 tx=0x7f9a1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18003b70 con 0x7f9a201f8720 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a18003d30 con 0x7f9a201f8720 2024-09-17T04:24:06.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a200cd220 con 0x7f9a201f8720 2024-09-17T04:24:06.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a180052d0 con 0x7f9a201f8720 2024-09-17T04:24:06.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.974+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a200cd7e0 con 0x7f9a201f8720 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.976+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2006e170 con 0x7f9a201f8720 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.976+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a18005470 con 0x7f9a201f8720 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.977+0000 7f9a1cff9640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 0x7f9a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.977+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9a1809a9b0 con 0x7f9a201f8720 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.977+0000 7f9a1ffff640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 0x7f9a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:06.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.977+0000 7f9a1ffff640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 0x7f9a0c07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a10034000 tx=0x7f9a10004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:06.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:06.981+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a201f9070 con 0x7f9a201f8720 2024-09-17T04:24:07.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:07.205+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a200ccfb0 con 0x7f9a201f8720 2024-09-17T04:24:08.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.181+0000 7f9a1cff9640 1 -- 172.21.15.63:0/2480171703 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f9a180627a0 con 0x7f9a201f8720 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 msgr2=0x7f9a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 0x7f9a0c07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a10034000 tx=0x7f9a10004730 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 msgr2=0x7f9a201f8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c730 tx=0x7f9a1800cbf0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 shutdown_connections 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9a0c078b90 0x7f9a0c07b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9a200ceb40 0x7f9a2015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a201f8720 0x7f9a201f8b30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 --2- 172.21.15.63:0/2480171703 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9a2006f4b0 0x7f9a200cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.184+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 >> 172.21.15.63:0/2480171703 conn(0x7f9a2008bfc0 msgr2=0x7f9a20161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:08.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.185+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 shutdown_connections 2024-09-17T04:24:08.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.185+0000 7f9a26663640 1 -- 172.21.15.63:0/2480171703 wait complete. 2024-09-17T04:24:08.198 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T04:24:08.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T04:24:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 -- 172.21.15.63:0/1566422804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b66b0 msgr2=0x7faa900b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 --2- 172.21.15.63:0/1566422804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b66b0 0x7faa900b9900 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa9008d780 tx=0x7faa8002a5f0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 -- 172.21.15.63:0/1566422804 shutdown_connections 2024-09-17T04:24:08.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 --2- 172.21.15.63:0/1566422804 >> v2:172.21.15.112:3300/0 conn(0x7faa900b3910 0x7faa9006e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 --2- 172.21.15.63:0/1566422804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b66b0 0x7faa900b9900 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 -- 172.21.15.63:0/1566422804 >> 172.21.15.63:0/1566422804 conn(0x7faa9009d830 msgr2=0x7faa900d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 -- 172.21.15.63:0/1566422804 shutdown_connections 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.327+0000 7faa9770b640 1 -- 172.21.15.63:0/1566422804 wait complete. 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.329+0000 7faa9770b640 1 Processor -- start 2024-09-17T04:24:08.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.329+0000 7faa9770b640 1 -- start start 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa900d4c30 0x7faa900cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa90161380 0x7faa9014ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faa9006eab0 con 0x7faa900b3910 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faa9006e930 con 0x7faa900d4c30 2024-09-17T04:24:08.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa9770b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faa9006ec30 con 0x7faa90161380 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa954a7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa954a7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46744/0 (socket says 172.21.15.63:46744) 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa954a7640 1 -- 172.21.15.63:0/4244362815 learned_addr learned my addr 172.21.15.63:0/4244362815 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa94ca6640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa900d4c30 0x7faa900cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.330+0000 7faa95ca8640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa90161380 0x7faa9014ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 -- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa90161380 msgr2=0x7faa9014ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa90161380 0x7faa9014ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 -- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa900d4c30 msgr2=0x7faa900cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa900d4c30 0x7faa900cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 -- 172.21.15.63:0/4244362815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9014b790 con 0x7faa900b3910 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa954a7640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c390 tx=0x7faa8c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:08.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c017070 con 0x7faa900b3910 2024-09-17T04:24:08.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa8c0053c0 con 0x7faa900b3910 2024-09-17T04:24:08.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9015c690 con 0x7faa900b3910 2024-09-17T04:24:08.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c003880 con 0x7faa900b3910 2024-09-17T04:24:08.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.331+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa90160e60 con 0x7faa900b3910 2024-09-17T04:24:08.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.332+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9006f1c0 con 0x7faa900b3910 2024-09-17T04:24:08.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.333+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa8c01a070 con 0x7faa900b3910 2024-09-17T04:24:08.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.334+0000 7faa85ffb640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:08.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.334+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7faa8c099fd0 con 0x7faa900b3910 2024-09-17T04:24:08.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.334+0000 7faa94ca6640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:08.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.334+0000 7faa94ca6640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 0x7faa7407b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa80033000 tx=0x7faa80004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.338+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faa8c061e50 con 0x7faa900b3910 2024-09-17T04:24:08.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:08.564+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faa900d42b0 con 0x7faa900b3910 2024-09-17T04:24:09.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.188+0000 7faa85ffb640 1 -- 172.21.15.63:0/4244362815 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7faa8c066880 con 0x7faa900b3910 2024-09-17T04:24:09.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 msgr2=0x7faa7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 0x7faa7407b0d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa80033000 tx=0x7faa80004730 comp rx=0 tx=0).stop 2024-09-17T04:24:09.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 msgr2=0x7faa9014b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faa8c00c390 tx=0x7faa8c00c850 comp rx=0 tx=0).stop 2024-09-17T04:24:09.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 shutdown_connections 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faa900d4c30 0x7faa900cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faa90161380 0x7faa9014ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 --2- 172.21.15.63:0/4244362815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa900b3910 0x7faa9014b250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 >> 172.21.15.63:0/4244362815 conn(0x7faa9009d830 msgr2=0x7faa900b7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 shutdown_connections 2024-09-17T04:24:09.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.190+0000 7faa9770b640 1 -- 172.21.15.63:0/4244362815 wait complete. 2024-09-17T04:24:09.202 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T04:24:09.202 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 -- 172.21.15.63:0/2787437307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040d1490 msgr2=0x7f6e040cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2787437307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040d1490 0x7f6e040cebf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc005fd0 tx=0x7f6dfc02aa90 comp rx=0 tx=0).stop 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 -- 172.21.15.63:0/2787437307 shutdown_connections 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2787437307 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040d1490 0x7f6e040cebf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2787437307 >> v2:172.21.15.112:3300/0 conn(0x7f6e040b51c0 0x7f6e0415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 -- 172.21.15.63:0/2787437307 >> 172.21.15.63:0/2787437307 conn(0x7f6e04072ae0 msgr2=0x7f6e04072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 -- 172.21.15.63:0/2787437307 shutdown_connections 2024-09-17T04:24:09.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.320+0000 7f6e0b416640 1 -- 172.21.15.63:0/2787437307 wait complete. 2024-09-17T04:24:09.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.322+0000 7f6e0b416640 1 Processor -- start 2024-09-17T04:24:09.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.322+0000 7f6e0b416640 1 -- start start 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e040b51c0 0x7f6e04159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040ccbd0 0x7f6e04156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040cf2b0 con 0x7f6e040d1490 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040cf130 con 0x7f6e040b51c0 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e0b416640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6e040cf430 con 0x7f6e040ccbd0 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46750/0 (socket says 172.21.15.63:46750) 2024-09-17T04:24:09.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 -- 172.21.15.63:0/2405419874 learned_addr learned my addr 172.21.15.63:0/2405419874 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e091b2640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e040b51c0 0x7f6e04159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e089b1640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040ccbd0 0x7f6e04156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 -- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040ccbd0 msgr2=0x7f6e04156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040ccbd0 0x7f6e04156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 -- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e040b51c0 msgr2=0x7f6e04159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e040b51c0 0x7f6e04159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.323+0000 7f6e099b3640 1 -- 172.21.15.63:0/2405419874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e041580e0 con 0x7f6e040d1490 2024-09-17T04:24:09.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6e099b3640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009d90 tx=0x7f6dfc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc044070 con 0x7f6e040d1490 2024-09-17T04:24:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dfc004040 con 0x7f6e040d1490 2024-09-17T04:24:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e041585e0 con 0x7f6e040d1490 2024-09-17T04:24:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc004450 con 0x7f6e040d1490 2024-09-17T04:24:09.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.324+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e04158ba0 con 0x7f6e040d1490 2024-09-17T04:24:09.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.325+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e040cf950 con 0x7f6e040d1490 2024-09-17T04:24:09.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.326+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6dfc047070 con 0x7f6e040d1490 2024-09-17T04:24:09.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.327+0000 7f6df9ffb640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 0x7f6de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.327+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6dfc0bbb40 con 0x7f6e040d1490 2024-09-17T04:24:09.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.327+0000 7f6e091b2640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 0x7f6de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.327+0000 7f6e091b2640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 0x7f6de807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e000095f0 tx=0x7f6e00005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:09.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.331+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6dfc032030 con 0x7f6e040d1490 2024-09-17T04:24:09.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.552+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e04158370 con 0x7f6e040d1490 2024-09-17T04:24:09.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.553+0000 7f6df9ffb640 1 -- 172.21.15.63:0/2405419874 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f6dfc083890 con 0x7f6e040d1490 2024-09-17T04:24:09.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:09.553 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:24:09.553 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 msgr2=0x7f6de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 0x7f6de807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e000095f0 tx=0x7f6e00005f90 comp rx=0 tx=0).stop 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 msgr2=0x7f6e0414e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009d90 tx=0x7f6dfc003ba0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 shutdown_connections 2024-09-17T04:24:09.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6de8078b90 0x7f6de807b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e040d1490 0x7f6e0414e6d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6e040ccbd0 0x7f6e04156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 --2- 172.21.15.63:0/2405419874 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6e040b51c0 0x7f6e04159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 >> 172.21.15.63:0/2405419874 conn(0x7f6e04072ae0 msgr2=0x7f6e040d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 shutdown_connections 2024-09-17T04:24:09.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.555+0000 7f6e0b416640 1 -- 172.21.15.63:0/2405419874 wait complete. 2024-09-17T04:24:09.567 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:24:09.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 -- 172.21.15.63:0/2827296313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe940005320 msgr2=0x7fe94000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 --2- 172.21.15.63:0/2827296313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe940005320 0x7fe94000b9e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c610 tx=0x7fe940005830 comp rx=0 tx=0).stop 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 -- 172.21.15.63:0/2827296313 shutdown_connections 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 --2- 172.21.15.63:0/2827296313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe940005320 0x7fe94000b9e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 -- 172.21.15.63:0/2827296313 >> 172.21.15.63:0/2827296313 conn(0x7fe9580cee20 msgr2=0x7fe9580cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 -- 172.21.15.63:0/2827296313 shutdown_connections 2024-09-17T04:24:09.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.684+0000 7fe95ec20640 1 -- 172.21.15.63:0/2827296313 wait complete. 2024-09-17T04:24:09.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.685+0000 7fe95ec20640 1 Processor -- start 2024-09-17T04:24:09.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.686+0000 7fe95ec20640 1 -- start start 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe940005320 0x7fe958159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9580cb710 0x7fe9581f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9580b3e20 con 0x7fe9580cb300 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe95815cc00 con 0x7fe940005320 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95ec20640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580b3fa0 con 0x7fe9580cb710 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe957fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe957fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46764/0 (socket says 172.21.15.63:46764) 2024-09-17T04:24:09.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe957fff640 1 -- 172.21.15.63:0/458565008 learned_addr learned my addr 172.21.15.63:0/458565008 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95d1bd640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9580cb710 0x7fe9581f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.687+0000 7fe95c9bc640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe940005320 0x7fe958159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 -- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9580cb710 msgr2=0x7fe9581f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9580cb710 0x7fe9581f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 -- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe940005320 msgr2=0x7fe958159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe940005320 0x7fe958159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 -- 172.21.15.63:0/458565008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe958159d60 con 0x7fe9580cb300 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe957fff640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe94c011ae0 tx=0x7fe94c009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c01e070 con 0x7fe9580cb300 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe94c004480 con 0x7fe9580cb300 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9580cc720 con 0x7fe9580cb300 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00fc60 con 0x7fe9580cb300 2024-09-17T04:24:09.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.688+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9580cbc60 con 0x7fe9580cb300 2024-09-17T04:24:09.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.689+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9580b4500 con 0x7fe9580cb300 2024-09-17T04:24:09.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.690+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe94c021070 con 0x7fe9580cb300 2024-09-17T04:24:09.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.691+0000 7fe9557fa640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 0x7fe94407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:09.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.691+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe94c09b840 con 0x7fe9580cb300 2024-09-17T04:24:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.691+0000 7fe95c9bc640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 0x7fe94407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:09.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.691+0000 7fe95c9bc640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 0x7fe94407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe9480064a0 tx=0x7fe948006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:09.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.695+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe94c063630 con 0x7fe9580cb300 2024-09-17T04:24:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.882+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9580c9640 con 0x7fe9580cb300 2024-09-17T04:24:09.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.884+0000 7fe9557fa640 1 -- 172.21.15.63:0/458565008 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7fe94c068060 con 0x7fe9580cb300 2024-09-17T04:24:09.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:09.884 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:24:07.168292+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:24:03.608048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T04:24:04.496167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 msgr2=0x7fe94407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 0x7fe94407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe9480064a0 tx=0x7fe948006b10 comp rx=0 tx=0).stop 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 msgr2=0x7fe9581f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe94c011ae0 tx=0x7fe94c009e40 comp rx=0 tx=0).stop 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 shutdown_connections 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe944078b90 0x7fe94407b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe9580cb710 0x7fe9581f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9580cb300 0x7fe9581f6350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 --2- 172.21.15.63:0/458565008 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe940005320 0x7fe958159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 >> 172.21.15.63:0/458565008 conn(0x7fe9580cee20 msgr2=0x7fe9580b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 shutdown_connections 2024-09-17T04:24:09.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:09.886+0000 7fe95ec20640 1 -- 172.21.15.63:0/458565008 wait complete. 2024-09-17T04:24:09.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:24:09.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:24:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 -- 172.21.15.63:0/2261184822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 msgr2=0x7f24b40b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 --2- 172.21.15.63:0/2261184822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b40b3710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009c90 tx=0x7f24a402aa30 comp rx=0 tx=0).stop 2024-09-17T04:24:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 -- 172.21.15.63:0/2261184822 shutdown_connections 2024-09-17T04:24:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 --2- 172.21.15.63:0/2261184822 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 0x7f24b406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 --2- 172.21.15.63:0/2261184822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b40b3710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 -- 172.21.15.63:0/2261184822 >> 172.21.15.63:0/2261184822 conn(0x7f24b409d7f0 msgr2=0x7f24b40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:10.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 -- 172.21.15.63:0/2261184822 shutdown_connections 2024-09-17T04:24:10.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.014+0000 7f24b8856640 1 -- 172.21.15.63:0/2261184822 wait complete. 2024-09-17T04:24:10.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.016+0000 7f24b8856640 1 Processor -- start 2024-09-17T04:24:10.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.016+0000 7f24b8856640 1 -- start start 2024-09-17T04:24:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.017+0000 7f24b8856640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 0x7f24b40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.017+0000 7f24b8856640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24b40b5fa0 0x7f24b41f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b8856640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b8856640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f24b406ea30 con 0x7f24b40b9970 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b8856640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f24b40d5010 con 0x7f24b40b5fa0 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b8856640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f24b406ebb0 con 0x7f24b406e0e0 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46782/0 (socket says 172.21.15.63:46782) 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 -- 172.21.15.63:0/1413409994 learned_addr learned my addr 172.21.15.63:0/1413409994 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:10.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b259c640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 0x7f24b40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b1d9b640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24b40b5fa0 0x7f24b41f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 -- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 msgr2=0x7f24b40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 0x7f24b40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 -- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24b40b5fa0 msgr2=0x7f24b41f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24b40b5fa0 0x7f24b41f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 -- 172.21.15.63:0/1413409994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b41506a0 con 0x7f24b40b9970 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b2d9d640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00e770 tx=0x7f24ac00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00ccc0 con 0x7f24b40b9970 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24ac00ee80 con 0x7f24b40b9970 2024-09-17T04:24:10.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.018+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b4150940 con 0x7f24b40b9970 2024-09-17T04:24:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.019+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac005280 con 0x7f24b40b9970 2024-09-17T04:24:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.019+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b4150f00 con 0x7f24b40b9970 2024-09-17T04:24:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.020+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b40b3710 con 0x7f24b40b9970 2024-09-17T04:24:10.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.020+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24ac005420 con 0x7f24b40b9970 2024-09-17T04:24:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.021+0000 7f24aaffd640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 0x7f249407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.021+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f24ac09b4d0 con 0x7f24b40b9970 2024-09-17T04:24:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.021+0000 7f24b259c640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 0x7f249407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.022+0000 7f24b259c640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 0x7f249407b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24a4035000 tx=0x7f24a403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.026+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24ac0632d0 con 0x7f24b40b9970 2024-09-17T04:24:10.095 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-09-17T04:24:10.095+0000 7f57708cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T04:24:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.208+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24b4069010 con 0x7f2494078bc0 2024-09-17T04:24:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.213+0000 7f24aaffd640 1 -- 172.21.15.63:0/1413409994 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240998 (secure 0 0 0) 0x7f24b4069010 con 0x7f2494078bc0 2024-09-17T04:24:10.216 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 msgr2=0x7f249407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 0x7f249407b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f24a4035000 tx=0x7f24a403b040 comp rx=0 tx=0).stop 2024-09-17T04:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 msgr2=0x7f24b41f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00e770 tx=0x7f24ac00ec30 comp rx=0 tx=0).stop 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 shutdown_connections 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2494078bc0 0x7f249407b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f24b40b5fa0 0x7f24b41f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24b40b9970 0x7f24b41f2740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 --2- 172.21.15.63:0/1413409994 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f24b406e0e0 0x7f24b40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 >> 172.21.15.63:0/1413409994 conn(0x7f24b409d7f0 msgr2=0x7f24b415eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 shutdown_connections 2024-09-17T04:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.216+0000 7f24b8856640 1 -- 172.21.15.63:0/1413409994 wait complete. 2024-09-17T04:24:10.228 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-17T04:24:08.408319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590480,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":109,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":219900,"kb_used_data":3624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754820,"statfs":{"total":773094113280,"available":772868935680,"internally_reserved":0,"allocated":3710976,"data_stored":2107000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259949"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184334+0000","last_change":"2024-09-17T04:24:06.181131+0000","last_active":"2024-09-17T04:24:06.184334+0000","last_peered":"2024-09-17T04:24:06.184334+0000","last_clean":"2024-09-17T04:24:06.184334+0000","last_became_active":"2024-09-17T04:24:06.180609+0000","last_became_peered":"2024-09-17T04:24:06.180609+0000","last_unstale":"2024-09-17T04:24:06.184334+0000","last_undegraded":"2024-09-17T04:24:06.184334+0000","last_fullsized":"2024-09-17T04:24:06.184334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:28.566769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187962+0000","last_change":"2024-09-17T04:24:06.185607+0000","last_active":"2024-09-17T04:24:06.187962+0000","last_peered":"2024-09-17T04:24:06.187962+0000","last_clean":"2024-09-17T04:24:06.187962+0000","last_became_active":"2024-09-17T04:24:06.184559+0000","last_became_peered":"2024-09-17T04:24:06.184559+0000","last_unstale":"2024-09-17T04:24:06.187962+0000","last_undegraded":"2024-09-17T04:24:06.187962+0000","last_fullsized":"2024-09-17T04:24:06.187962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:40.325611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.196405+0000","last_change":"2024-09-17T04:24:06.193914+0000","last_active":"2024-09-17T04:24:06.196405+0000","last_peered":"2024-09-17T04:24:06.196405+0000","last_clean":"2024-09-17T04:24:06.196405+0000","last_became_active":"2024-09-17T04:24:06.193584+0000","last_became_peered":"2024-09-17T04:24:06.193584+0000","last_unstale":"2024-09-17T04:24:06.196405+0000","last_undegraded":"2024-09-17T04:24:06.196405+0000","last_fullsized":"2024-09-17T04:24:06.196405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:19.233966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.182404+0000","last_change":"2024-09-17T04:24:06.180667+0000","last_active":"2024-09-17T04:24:06.182404+0000","last_peered":"2024-09-17T04:24:06.182404+0000","last_clean":"2024-09-17T04:24:06.182404+0000","last_became_active":"2024-09-17T04:24:06.179872+0000","last_became_peered":"2024-09-17T04:24:06.179872+0000","last_unstale":"2024-09-17T04:24:06.182404+0000","last_undegraded":"2024-09-17T04:24:06.182404+0000","last_fullsized":"2024-09-17T04:24:06.182404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.422249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.177110+0000","last_change":"2024-09-17T04:24:06.167507+0000","last_active":"2024-09-17T04:24:06.177110+0000","last_peered":"2024-09-17T04:24:06.177110+0000","last_clean":"2024-09-17T04:24:06.177110+0000","last_became_active":"2024-09-17T04:24:06.166756+0000","last_became_peered":"2024-09-17T04:24:06.166756+0000","last_unstale":"2024-09-17T04:24:06.177110+0000","last_undegraded":"2024-09-17T04:24:06.177110+0000","last_fullsized":"2024-09-17T04:24:06.177110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:12.473895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.183280+0000","last_change":"2024-09-17T04:24:06.182050+0000","last_active":"2024-09-17T04:24:06.183280+0000","last_peered":"2024-09-17T04:24:06.183280+0000","last_clean":"2024-09-17T04:24:06.183280+0000","last_became_active":"2024-09-17T04:24:06.181735+0000","last_became_peered":"2024-09-17T04:24:06.181735+0000","last_unstale":"2024-09-17T04:24:06.183280+0000","last_undegraded":"2024-09-17T04:24:06.183280+0000","last_fullsized":"2024-09-17T04:24:06.183280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:43.104618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.188809+0000","last_change":"2024-09-17T04:24:06.185607+0000","last_active":"2024-09-17T04:24:06.188809+0000","last_peered":"2024-09-17T04:24:06.188809+0000","last_clean":"2024-09-17T04:24:06.188809+0000","last_became_active":"2024-09-17T04:24:06.184136+0000","last_became_peered":"2024-09-17T04:24:06.184136+0000","last_unstale":"2024-09-17T04:24:06.188809+0000","last_undegraded":"2024-09-17T04:24:06.188809+0000","last_fullsized":"2024-09-17T04:24:06.188809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:59.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187882+0000","last_change":"2024-09-17T04:24:06.182419+0000","last_active":"2024-09-17T04:24:06.187882+0000","last_peered":"2024-09-17T04:24:06.187882+0000","last_clean":"2024-09-17T04:24:06.187882+0000","last_became_active":"2024-09-17T04:24:06.181879+0000","last_became_peered":"2024-09-17T04:24:06.181879+0000","last_unstale":"2024-09-17T04:24:06.187882+0000","last_undegraded":"2024-09-17T04:24:06.187882+0000","last_fullsized":"2024-09-17T04:24:06.187882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:42.532593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.176426+0000","last_change":"2024-09-17T04:24:06.170807+0000","last_active":"2024-09-17T04:24:06.176426+0000","last_peered":"2024-09-17T04:24:06.176426+0000","last_clean":"2024-09-17T04:24:06.176426+0000","last_became_active":"2024-09-17T04:24:06.170499+0000","last_became_peered":"2024-09-17T04:24:06.170499+0000","last_unstale":"2024-09-17T04:24:06.176426+0000","last_undegraded":"2024-09-17T04:24:06.176426+0000","last_fullsized":"2024-09-17T04:24:06.176426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:40.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187852+0000","last_change":"2024-09-17T04:24:06.180403+0000","last_active":"2024-09-17T04:24:06.187852+0000","last_peered":"2024-09-17T04:24:06.187852+0000","last_clean":"2024-09-17T04:24:06.187852+0000","last_became_active":"2024-09-17T04:24:06.180015+0000","last_became_peered":"2024-09-17T04:24:06.180015+0000","last_unstale":"2024-09-17T04:24:06.187852+0000","last_undegraded":"2024-09-17T04:24:06.187852+0000","last_fullsized":"2024-09-17T04:24:06.187852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:28.131134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.178013+0000","last_change":"2024-09-17T04:24:06.171640+0000","last_active":"2024-09-17T04:24:06.178013+0000","last_peered":"2024-09-17T04:24:06.178013+0000","last_clean":"2024-09-17T04:24:06.178013+0000","last_became_active":"2024-09-17T04:24:06.171325+0000","last_became_peered":"2024-09-17T04:24:06.171325+0000","last_unstale":"2024-09-17T04:24:06.178013+0000","last_undegraded":"2024-09-17T04:24:06.178013+0000","last_fullsized":"2024-09-17T04:24:06.178013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:59.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187787+0000","last_change":"2024-09-17T04:24:06.183784+0000","last_active":"2024-09-17T04:24:06.187787+0000","last_peered":"2024-09-17T04:24:06.187787+0000","last_clean":"2024-09-17T04:24:06.187787+0000","last_became_active":"2024-09-17T04:24:06.183304+0000","last_became_peered":"2024-09-17T04:24:06.183304+0000","last_unstale":"2024-09-17T04:24:06.187787+0000","last_undegraded":"2024-09-17T04:24:06.187787+0000","last_fullsized":"2024-09-17T04:24:06.187787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:12.473895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.182347+0000","last_change":"2024-09-17T04:24:06.179898+0000","last_active":"2024-09-17T04:24:06.182347+0000","last_peered":"2024-09-17T04:24:06.182347+0000","last_clean":"2024-09-17T04:24:06.182347+0000","last_became_active":"2024-09-17T04:24:06.179593+0000","last_became_peered":"2024-09-17T04:24:06.179593+0000","last_unstale":"2024-09-17T04:24:06.182347+0000","last_undegraded":"2024-09-17T04:24:06.182347+0000","last_fullsized":"2024-09-17T04:24:06.182347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:19.233966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.178894+0000","last_change":"2024-09-17T04:24:05.170882+0000","last_active":"2024-09-17T04:24:06.178894+0000","last_peered":"2024-09-17T04:24:06.178894+0000","last_clean":"2024-09-17T04:24:06.178894+0000","last_became_active":"2024-09-17T04:24:05.170537+0000","last_became_peered":"2024-09-17T04:24:05.170537+0000","last_unstale":"2024-09-17T04:24:06.178894+0000","last_undegraded":"2024-09-17T04:24:06.178894+0000","last_fullsized":"2024-09-17T04:24:06.178894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:41.524656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184361+0000","last_change":"2024-09-17T04:24:06.182372+0000","last_active":"2024-09-17T04:24:06.184361+0000","last_peered":"2024-09-17T04:24:06.184361+0000","last_clean":"2024-09-17T04:24:06.184361+0000","last_became_active":"2024-09-17T04:24:06.182066+0000","last_became_peered":"2024-09-17T04:24:06.182066+0000","last_unstale":"2024-09-17T04:24:06.184361+0000","last_undegraded":"2024-09-17T04:24:06.184361+0000","last_fullsized":"2024-09-17T04:24:06.184361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:43.638743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.188790+0000","last_change":"2024-09-17T04:24:06.184296+0000","last_active":"2024-09-17T04:24:06.188790+0000","last_peered":"2024-09-17T04:24:06.188790+0000","last_clean":"2024-09-17T04:24:06.188790+0000","last_became_active":"2024-09-17T04:24:06.182930+0000","last_became_peered":"2024-09-17T04:24:06.182930+0000","last_unstale":"2024-09-17T04:24:06.188790+0000","last_undegraded":"2024-09-17T04:24:06.188790+0000","last_fullsized":"2024-09-17T04:24:06.188790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:40.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.171681+0000","last_change":"2024-09-17T04:24:05.167419+0000","last_active":"2024-09-17T04:24:06.171681+0000","last_peered":"2024-09-17T04:24:06.171681+0000","last_clean":"2024-09-17T04:24:06.171681+0000","last_became_active":"2024-09-17T04:24:05.166636+0000","last_became_peered":"2024-09-17T04:24:05.166636+0000","last_unstale":"2024-09-17T04:24:06.171681+0000","last_undegraded":"2024-09-17T04:24:06.171681+0000","last_fullsized":"2024-09-17T04:24:06.171681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:35.920064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.193725+0000","last_change":"2024-09-17T04:24:05.171787+0000","last_active":"2024-09-17T04:24:06.193725+0000","last_peered":"2024-09-17T04:24:06.193725+0000","last_clean":"2024-09-17T04:24:06.193725+0000","last_became_active":"2024-09-17T04:24:05.171468+0000","last_became_peered":"2024-09-17T04:24:05.171468+0000","last_unstale":"2024-09-17T04:24:06.193725+0000","last_undegraded":"2024-09-17T04:24:06.193725+0000","last_fullsized":"2024-09-17T04:24:06.193725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.770483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.176466+0000","last_change":"2024-09-17T04:24:06.170829+0000","last_active":"2024-09-17T04:24:06.176466+0000","last_peered":"2024-09-17T04:24:06.176466+0000","last_clean":"2024-09-17T04:24:06.176466+0000","last_became_active":"2024-09-17T04:24:06.169177+0000","last_became_peered":"2024-09-17T04:24:06.169177+0000","last_unstale":"2024-09-17T04:24:06.176466+0000","last_undegraded":"2024-09-17T04:24:06.176466+0000","last_fullsized":"2024-09-17T04:24:06.176466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:40.325611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187759+0000","last_change":"2024-09-17T04:24:06.183604+0000","last_active":"2024-09-17T04:24:06.187759+0000","last_peered":"2024-09-17T04:24:06.187759+0000","last_clean":"2024-09-17T04:24:06.187759+0000","last_became_active":"2024-09-17T04:24:06.183274+0000","last_became_peered":"2024-09-17T04:24:06.183274+0000","last_unstale":"2024-09-17T04:24:06.187759+0000","last_undegraded":"2024-09-17T04:24:06.187759+0000","last_fullsized":"2024-09-17T04:24:06.187759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:02.991394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.162170+0000","last_change":"2024-09-17T04:24:05.175432+0000","last_active":"2024-09-17T04:24:06.162170+0000","last_peered":"2024-09-17T04:24:06.162170+0000","last_clean":"2024-09-17T04:24:06.162170+0000","last_became_active":"2024-09-17T04:24:05.175015+0000","last_became_peered":"2024-09-17T04:24:05.175015+0000","last_unstale":"2024-09-17T04:24:06.162170+0000","last_undegraded":"2024-09-17T04:24:06.162170+0000","last_fullsized":"2024-09-17T04:24:06.162170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:01.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187601+0000","last_change":"2024-09-17T04:24:05.172564+0000","last_active":"2024-09-17T04:24:06.187601+0000","last_peered":"2024-09-17T04:24:06.187601+0000","last_clean":"2024-09-17T04:24:06.187601+0000","last_became_active":"2024-09-17T04:24:05.172236+0000","last_became_peered":"2024-09-17T04:24:05.172236+0000","last_unstale":"2024-09-17T04:24:06.187601+0000","last_undegraded":"2024-09-17T04:24:06.187601+0000","last_fullsized":"2024-09-17T04:24:06.187601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:10.151102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184418+0000","last_change":"2024-09-17T04:24:06.182541+0000","last_active":"2024-09-17T04:24:06.184418+0000","last_peered":"2024-09-17T04:24:06.184418+0000","last_clean":"2024-09-17T04:24:06.184418+0000","last_became_active":"2024-09-17T04:24:06.182177+0000","last_became_peered":"2024-09-17T04:24:06.182177+0000","last_unstale":"2024-09-17T04:24:06.184418+0000","last_undegraded":"2024-09-17T04:24:06.184418+0000","last_fullsized":"2024-09-17T04:24:06.184418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:39.052827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.174562+0000","last_change":"2024-09-17T04:24:05.171231+0000","last_active":"2024-09-17T04:24:06.174562+0000","last_peered":"2024-09-17T04:24:06.174562+0000","last_clean":"2024-09-17T04:24:06.174562+0000","last_became_active":"2024-09-17T04:24:05.170941+0000","last_became_peered":"2024-09-17T04:24:05.170941+0000","last_unstale":"2024-09-17T04:24:06.174562+0000","last_undegraded":"2024-09-17T04:24:06.174562+0000","last_fullsized":"2024-09-17T04:24:06.174562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:17.999891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.171765+0000","last_change":"2024-09-17T04:24:05.172804+0000","last_active":"2024-09-17T04:24:06.171765+0000","last_peered":"2024-09-17T04:24:06.171765+0000","last_clean":"2024-09-17T04:24:06.171765+0000","last_became_active":"2024-09-17T04:24:05.172497+0000","last_became_peered":"2024-09-17T04:24:05.172497+0000","last_unstale":"2024-09-17T04:24:06.171765+0000","last_undegraded":"2024-09-17T04:24:06.171765+0000","last_fullsized":"2024-09-17T04:24:06.171765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:10.662887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:05.143106+0000","last_change":"2024-09-17T04:24:05.143106+0000","last_active":"2024-09-17T04:24:05.143106+0000","last_peered":"2024-09-17T04:24:05.143106+0000","last_clean":"2024-09-17T04:24:05.143106+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:05.143106+0000","last_undegraded":"2024-09-17T04:24:05.143106+0000","last_fullsized":"2024-09-17T04:24:05.143106+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T04:24:04.135170+0000","last_change":"2024-09-17T04:24:04.135170+0000","last_active":"2024-09-17T04:24:04.135170+0000","last_peered":"2024-09-17T04:24:04.135170+0000","last_clean":"2024-09-17T04:24:04.135170+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T04:24:04.135170+0000","last_undegraded":"2024-09-17T04:24:04.135170+0000","last_fullsized":"2024-09-17T04:24:04.135170+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T04:24:00.483565+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:24:00.483565+0000","last_peered":"2024-09-17T04:24:00.483565+0000","last_clean":"2024-09-17T04:24:00.483565+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:24:00.483565+0000","last_undegraded":"2024-09-17T04:24:00.483565+0000","last_fullsized":"2024-09-17T04:24:00.483565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":112,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":14,"acting":14,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27324,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27328,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":303104,"data_stored":110780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":897024,"data_stored":701148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:24:10.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:24:10.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 -- 172.21.15.63:0/2558311336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0d1a80 msgr2=0x7f516c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 --2- 172.21.15.63:0/2558311336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0d1a80 0x7f516c0cf090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5160005fd0 tx=0x7f516002a5d0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 -- 172.21.15.63:0/2558311336 shutdown_connections 2024-09-17T04:24:10.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 --2- 172.21.15.63:0/2558311336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0d1a80 0x7f516c0cf090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 -- 172.21.15.63:0/2558311336 >> 172.21.15.63:0/2558311336 conn(0x7f516c08bfc0 msgr2=0x7f516c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:10.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 -- 172.21.15.63:0/2558311336 shutdown_connections 2024-09-17T04:24:10.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.384+0000 7f5172a4d640 1 -- 172.21.15.63:0/2558311336 wait complete. 2024-09-17T04:24:10.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.386+0000 7f5172a4d640 1 Processor -- start 2024-09-17T04:24:10.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.386+0000 7f5172a4d640 1 -- start start 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.387+0000 7f5172a4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f516c0d1a80 0x7f516c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 0x7f516c0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f516c162df0 con 0x7f516c0cf5d0 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f516c162f70 con 0x7f516c0d2ed0 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f516c1630f0 con 0x7f516c0d1a80 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55748/0 (socket says 172.21.15.63:55748) 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 -- 172.21.15.63:0/3259820639 learned_addr learned my addr 172.21.15.63:0/3259820639 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516b7fe640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f516c0d1a80 0x7f516c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5170fea640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 0x7f516c0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 -- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f516c0d1a80 msgr2=0x7f516c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f516c0d1a80 0x7f516c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 -- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 msgr2=0x7f516c0b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 0x7f516c0b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 -- 172.21.15.63:0/3259820639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c0c92a0 con 0x7f516c0cf5d0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5170fea640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 0x7f516c0b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f516bfff640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c3c0 tx=0x7f515c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c017070 con 0x7f516c0cf5d0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f515c0035f0 con 0x7f516c0cf5d0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c1fa640 con 0x7f516c0cf5d0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c003a20 con 0x7f516c0cf5d0 2024-09-17T04:24:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.388+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c0c84e0 con 0x7f516c0cf5d0 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.389+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c0cf090 con 0x7f516c0cf5d0 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.390+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f515c01a070 con 0x7f516c0cf5d0 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.391+0000 7f5168ff9640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 0x7f515807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.391+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f515c099f20 con 0x7f516c0cf5d0 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.391+0000 7f516b7fe640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 0x7f515807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.392+0000 7f516b7fe640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 0x7f515807b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5160033000 tx=0x7f5160004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.395+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f515c061d10 con 0x7f516c0cf5d0 2024-09-17T04:24:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.579+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f516c0b56d0 con 0x7f5158078bc0 2024-09-17T04:24:10.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.584+0000 7f5168ff9640 1 -- 172.21.15.63:0/3259820639 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f516c0b56d0 con 0x7f5158078bc0 2024-09-17T04:24:10.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:10.587 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 msgr2=0x7f515807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 0x7f515807b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5160033000 tx=0x7f5160004730 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 msgr2=0x7f516c1fa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c3c0 tx=0x7f515c00c880 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 shutdown_connections 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5158078bc0 0x7f515807b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f516c0d2ed0 0x7f516c0b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f516c0d1a80 0x7f516c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 --2- 172.21.15.63:0/3259820639 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f516c0cf5d0 0x7f516c1fa100 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 >> 172.21.15.63:0/3259820639 conn(0x7f516c08bfc0 msgr2=0x7f516c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 shutdown_connections 2024-09-17T04:24:10.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.587+0000 7f5172a4d640 1 -- 172.21.15.63:0/3259820639 wait complete. 2024-09-17T04:24:10.598 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-17T04:24:10.408819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220196,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754524,"statfs":{"total":773094113280,"available":772868632576,"internally_reserved":0,"allocated":4046848,"data_stored":2260468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001509"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062546+0000","last_change":"2024-09-17T04:24:06.178666+0000","last_active":"2024-09-17T04:24:08.062546+0000","last_peered":"2024-09-17T04:24:08.062546+0000","last_clean":"2024-09-17T04:24:08.062546+0000","last_became_active":"2024-09-17T04:24:06.178327+0000","last_became_peered":"2024-09-17T04:24:06.178327+0000","last_unstale":"2024-09-17T04:24:08.062546+0000","last_undegraded":"2024-09-17T04:24:08.062546+0000","last_fullsized":"2024-09-17T04:24:08.062546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:02.620411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176492+0000","last_change":"2024-09-17T04:24:06.177575+0000","last_active":"2024-09-17T04:24:07.176492+0000","last_peered":"2024-09-17T04:24:07.176492+0000","last_clean":"2024-09-17T04:24:07.176492+0000","last_became_active":"2024-09-17T04:24:06.177115+0000","last_became_peered":"2024-09-17T04:24:06.177115+0000","last_unstale":"2024-09-17T04:24:07.176492+0000","last_undegraded":"2024-09-17T04:24:07.176492+0000","last_fullsized":"2024-09-17T04:24:07.176492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:37.642499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184334+0000","last_change":"2024-09-17T04:24:06.181131+0000","last_active":"2024-09-17T04:24:06.184334+0000","last_peered":"2024-09-17T04:24:06.184334+0000","last_clean":"2024-09-17T04:24:06.184334+0000","last_became_active":"2024-09-17T04:24:06.180609+0000","last_became_peered":"2024-09-17T04:24:06.180609+0000","last_unstale":"2024-09-17T04:24:06.184334+0000","last_undegraded":"2024-09-17T04:24:06.184334+0000","last_fullsized":"2024-09-17T04:24:06.184334+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:28.566769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187962+0000","last_change":"2024-09-17T04:24:06.185607+0000","last_active":"2024-09-17T04:24:06.187962+0000","last_peered":"2024-09-17T04:24:06.187962+0000","last_clean":"2024-09-17T04:24:06.187962+0000","last_became_active":"2024-09-17T04:24:06.184559+0000","last_became_peered":"2024-09-17T04:24:06.184559+0000","last_unstale":"2024-09-17T04:24:06.187962+0000","last_undegraded":"2024-09-17T04:24:06.187962+0000","last_fullsized":"2024-09-17T04:24:06.187962+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:40.325611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062920+0000","last_change":"2024-09-17T04:24:06.179287+0000","last_active":"2024-09-17T04:24:08.062920+0000","last_peered":"2024-09-17T04:24:08.062920+0000","last_clean":"2024-09-17T04:24:08.062920+0000","last_became_active":"2024-09-17T04:24:06.178953+0000","last_became_peered":"2024-09-17T04:24:06.178953+0000","last_unstale":"2024-09-17T04:24:08.062920+0000","last_undegraded":"2024-09-17T04:24:08.062920+0000","last_fullsized":"2024-09-17T04:24:08.062920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:37.219351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176428+0000","last_change":"2024-09-17T04:24:06.180719+0000","last_active":"2024-09-17T04:24:07.176428+0000","last_peered":"2024-09-17T04:24:07.176428+0000","last_clean":"2024-09-17T04:24:07.176428+0000","last_became_active":"2024-09-17T04:24:06.180391+0000","last_became_peered":"2024-09-17T04:24:06.180391+0000","last_unstale":"2024-09-17T04:24:07.176428+0000","last_undegraded":"2024-09-17T04:24:07.176428+0000","last_fullsized":"2024-09-17T04:24:07.176428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:28.674996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303935+0000","last_change":"2024-09-17T04:24:06.173277+0000","last_active":"2024-09-17T04:24:07.303935+0000","last_peered":"2024-09-17T04:24:07.303935+0000","last_clean":"2024-09-17T04:24:07.303935+0000","last_became_active":"2024-09-17T04:24:06.172918+0000","last_became_peered":"2024-09-17T04:24:06.172918+0000","last_unstale":"2024-09-17T04:24:07.303935+0000","last_undegraded":"2024-09-17T04:24:07.303935+0000","last_fullsized":"2024-09-17T04:24:07.303935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:53.481323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303750+0000","last_change":"2024-09-17T04:24:06.184321+0000","last_active":"2024-09-17T04:24:07.303750+0000","last_peered":"2024-09-17T04:24:07.303750+0000","last_clean":"2024-09-17T04:24:07.303750+0000","last_became_active":"2024-09-17T04:24:06.183999+0000","last_became_peered":"2024-09-17T04:24:06.183999+0000","last_unstale":"2024-09-17T04:24:07.303750+0000","last_undegraded":"2024-09-17T04:24:07.303750+0000","last_fullsized":"2024-09-17T04:24:07.303750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:52.849150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179286+0000","last_change":"2024-09-17T04:24:06.180757+0000","last_active":"2024-09-17T04:24:07.179286+0000","last_peered":"2024-09-17T04:24:07.179286+0000","last_clean":"2024-09-17T04:24:07.179286+0000","last_became_active":"2024-09-17T04:24:06.180449+0000","last_became_peered":"2024-09-17T04:24:06.180449+0000","last_unstale":"2024-09-17T04:24:07.179286+0000","last_undegraded":"2024-09-17T04:24:07.179286+0000","last_fullsized":"2024-09-17T04:24:07.179286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:02.385059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.196405+0000","last_change":"2024-09-17T04:24:06.193914+0000","last_active":"2024-09-17T04:24:06.196405+0000","last_peered":"2024-09-17T04:24:06.196405+0000","last_clean":"2024-09-17T04:24:06.196405+0000","last_became_active":"2024-09-17T04:24:06.193584+0000","last_became_peered":"2024-09-17T04:24:06.193584+0000","last_unstale":"2024-09-17T04:24:06.196405+0000","last_undegraded":"2024-09-17T04:24:06.196405+0000","last_fullsized":"2024-09-17T04:24:06.196405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:19.233966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303899+0000","last_change":"2024-09-17T04:24:06.188586+0000","last_active":"2024-09-17T04:24:07.303899+0000","last_peered":"2024-09-17T04:24:07.303899+0000","last_clean":"2024-09-17T04:24:07.303899+0000","last_became_active":"2024-09-17T04:24:06.188316+0000","last_became_peered":"2024-09-17T04:24:06.188316+0000","last_unstale":"2024-09-17T04:24:07.303899+0000","last_undegraded":"2024-09-17T04:24:07.303899+0000","last_fullsized":"2024-09-17T04:24:07.303899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.021863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.182404+0000","last_change":"2024-09-17T04:24:06.180667+0000","last_active":"2024-09-17T04:24:06.182404+0000","last_peered":"2024-09-17T04:24:06.182404+0000","last_clean":"2024-09-17T04:24:06.182404+0000","last_became_active":"2024-09-17T04:24:06.179872+0000","last_became_peered":"2024-09-17T04:24:06.179872+0000","last_unstale":"2024-09-17T04:24:06.182404+0000","last_undegraded":"2024-09-17T04:24:06.182404+0000","last_fullsized":"2024-09-17T04:24:06.182404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:37.422249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062699+0000","last_change":"2024-09-17T04:24:06.183977+0000","last_active":"2024-09-17T04:24:08.062699+0000","last_peered":"2024-09-17T04:24:08.062699+0000","last_clean":"2024-09-17T04:24:08.062699+0000","last_became_active":"2024-09-17T04:24:06.182582+0000","last_became_peered":"2024-09-17T04:24:06.182582+0000","last_unstale":"2024-09-17T04:24:08.062699+0000","last_undegraded":"2024-09-17T04:24:08.062699+0000","last_fullsized":"2024-09-17T04:24:08.062699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:59.781033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176243+0000","last_change":"2024-09-17T04:24:06.187052+0000","last_active":"2024-09-17T04:24:07.176243+0000","last_peered":"2024-09-17T04:24:07.176243+0000","last_clean":"2024-09-17T04:24:07.176243+0000","last_became_active":"2024-09-17T04:24:06.186688+0000","last_became_peered":"2024-09-17T04:24:06.186688+0000","last_unstale":"2024-09-17T04:24:07.176243+0000","last_undegraded":"2024-09-17T04:24:07.176243+0000","last_fullsized":"2024-09-17T04:24:07.176243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:09.734539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.177110+0000","last_change":"2024-09-17T04:24:06.167507+0000","last_active":"2024-09-17T04:24:06.177110+0000","last_peered":"2024-09-17T04:24:06.177110+0000","last_clean":"2024-09-17T04:24:06.177110+0000","last_became_active":"2024-09-17T04:24:06.166756+0000","last_became_peered":"2024-09-17T04:24:06.166756+0000","last_unstale":"2024-09-17T04:24:06.177110+0000","last_undegraded":"2024-09-17T04:24:06.177110+0000","last_fullsized":"2024-09-17T04:24:06.177110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:12.473895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304345+0000","last_change":"2024-09-17T04:24:06.193856+0000","last_active":"2024-09-17T04:24:07.304345+0000","last_peered":"2024-09-17T04:24:07.304345+0000","last_clean":"2024-09-17T04:24:07.304345+0000","last_became_active":"2024-09-17T04:24:06.193593+0000","last_became_peered":"2024-09-17T04:24:06.193593+0000","last_unstale":"2024-09-17T04:24:07.304345+0000","last_undegraded":"2024-09-17T04:24:07.304345+0000","last_fullsized":"2024-09-17T04:24:07.304345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:04.963155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304122+0000","last_change":"2024-09-17T04:24:06.171373+0000","last_active":"2024-09-17T04:24:07.304122+0000","last_peered":"2024-09-17T04:24:07.304122+0000","last_clean":"2024-09-17T04:24:07.304122+0000","last_became_active":"2024-09-17T04:24:06.171075+0000","last_became_peered":"2024-09-17T04:24:06.171075+0000","last_unstale":"2024-09-17T04:24:07.304122+0000","last_undegraded":"2024-09-17T04:24:07.304122+0000","last_fullsized":"2024-09-17T04:24:07.304122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:09.734539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176602+0000","last_change":"2024-09-17T04:24:06.188317+0000","last_active":"2024-09-17T04:24:07.176602+0000","last_peered":"2024-09-17T04:24:07.176602+0000","last_clean":"2024-09-17T04:24:07.176602+0000","last_became_active":"2024-09-17T04:24:06.187988+0000","last_became_peered":"2024-09-17T04:24:06.187988+0000","last_unstale":"2024-09-17T04:24:07.176602+0000","last_undegraded":"2024-09-17T04:24:07.176602+0000","last_fullsized":"2024-09-17T04:24:07.176602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:33.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176248+0000","last_change":"2024-09-17T04:24:06.191513+0000","last_active":"2024-09-17T04:24:07.176248+0000","last_peered":"2024-09-17T04:24:07.176248+0000","last_clean":"2024-09-17T04:24:07.176248+0000","last_became_active":"2024-09-17T04:24:06.191175+0000","last_became_peered":"2024-09-17T04:24:06.191175+0000","last_unstale":"2024-09-17T04:24:07.176248+0000","last_undegraded":"2024-09-17T04:24:07.176248+0000","last_fullsized":"2024-09-17T04:24:07.176248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:50.700716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062688+0000","last_change":"2024-09-17T04:24:06.181640+0000","last_active":"2024-09-17T04:24:08.062688+0000","last_peered":"2024-09-17T04:24:08.062688+0000","last_clean":"2024-09-17T04:24:08.062688+0000","last_became_active":"2024-09-17T04:24:06.181272+0000","last_became_peered":"2024-09-17T04:24:06.181272+0000","last_unstale":"2024-09-17T04:24:08.062688+0000","last_undegraded":"2024-09-17T04:24:08.062688+0000","last_fullsized":"2024-09-17T04:24:08.062688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:13.454375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.180008+0000","last_change":"2024-09-17T04:24:06.163167+0000","last_active":"2024-09-17T04:24:07.180008+0000","last_peered":"2024-09-17T04:24:07.180008+0000","last_clean":"2024-09-17T04:24:07.180008+0000","last_became_active":"2024-09-17T04:24:06.162792+0000","last_became_peered":"2024-09-17T04:24:06.162792+0000","last_unstale":"2024-09-17T04:24:07.180008+0000","last_undegraded":"2024-09-17T04:24:07.180008+0000","last_fullsized":"2024-09-17T04:24:07.180008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:21.660955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.178515+0000","last_change":"2024-09-17T04:24:06.187580+0000","last_active":"2024-09-17T04:24:07.178515+0000","last_peered":"2024-09-17T04:24:07.178515+0000","last_clean":"2024-09-17T04:24:07.178515+0000","last_became_active":"2024-09-17T04:24:06.187283+0000","last_became_peered":"2024-09-17T04:24:06.187283+0000","last_unstale":"2024-09-17T04:24:07.178515+0000","last_undegraded":"2024-09-17T04:24:07.178515+0000","last_fullsized":"2024-09-17T04:24:07.178515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:34.696656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985271+0000","last_change":"2024-09-17T04:24:06.169079+0000","last_active":"2024-09-17T04:24:07.985271+0000","last_peered":"2024-09-17T04:24:07.985271+0000","last_clean":"2024-09-17T04:24:07.985271+0000","last_became_active":"2024-09-17T04:24:06.168733+0000","last_became_peered":"2024-09-17T04:24:06.168733+0000","last_unstale":"2024-09-17T04:24:07.985271+0000","last_undegraded":"2024-09-17T04:24:07.985271+0000","last_fullsized":"2024-09-17T04:24:07.985271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:36.726768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.183280+0000","last_change":"2024-09-17T04:24:06.182050+0000","last_active":"2024-09-17T04:24:06.183280+0000","last_peered":"2024-09-17T04:24:06.183280+0000","last_clean":"2024-09-17T04:24:06.183280+0000","last_became_active":"2024-09-17T04:24:06.181735+0000","last_became_peered":"2024-09-17T04:24:06.181735+0000","last_unstale":"2024-09-17T04:24:06.183280+0000","last_undegraded":"2024-09-17T04:24:06.183280+0000","last_fullsized":"2024-09-17T04:24:06.183280+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:43.104618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.188809+0000","last_change":"2024-09-17T04:24:06.185607+0000","last_active":"2024-09-17T04:24:06.188809+0000","last_peered":"2024-09-17T04:24:06.188809+0000","last_clean":"2024-09-17T04:24:06.188809+0000","last_became_active":"2024-09-17T04:24:06.184136+0000","last_became_peered":"2024-09-17T04:24:06.184136+0000","last_unstale":"2024-09-17T04:24:06.188809+0000","last_undegraded":"2024-09-17T04:24:06.188809+0000","last_fullsized":"2024-09-17T04:24:06.188809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:59.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176757+0000","last_change":"2024-09-17T04:24:06.177862+0000","last_active":"2024-09-17T04:24:07.176757+0000","last_peered":"2024-09-17T04:24:07.176757+0000","last_clean":"2024-09-17T04:24:07.176757+0000","last_became_active":"2024-09-17T04:24:06.177536+0000","last_became_peered":"2024-09-17T04:24:06.177536+0000","last_unstale":"2024-09-17T04:24:07.176757+0000","last_undegraded":"2024-09-17T04:24:07.176757+0000","last_fullsized":"2024-09-17T04:24:07.176757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:56.373187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187882+0000","last_change":"2024-09-17T04:24:06.182419+0000","last_active":"2024-09-17T04:24:06.187882+0000","last_peered":"2024-09-17T04:24:06.187882+0000","last_clean":"2024-09-17T04:24:06.187882+0000","last_became_active":"2024-09-17T04:24:06.181879+0000","last_became_peered":"2024-09-17T04:24:06.181879+0000","last_unstale":"2024-09-17T04:24:06.187882+0000","last_undegraded":"2024-09-17T04:24:06.187882+0000","last_fullsized":"2024-09-17T04:24:06.187882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:42.532593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.176426+0000","last_change":"2024-09-17T04:24:06.170807+0000","last_active":"2024-09-17T04:24:06.176426+0000","last_peered":"2024-09-17T04:24:06.176426+0000","last_clean":"2024-09-17T04:24:06.176426+0000","last_became_active":"2024-09-17T04:24:06.170499+0000","last_became_peered":"2024-09-17T04:24:06.170499+0000","last_unstale":"2024-09-17T04:24:06.176426+0000","last_undegraded":"2024-09-17T04:24:06.176426+0000","last_fullsized":"2024-09-17T04:24:06.176426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:40.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.180206+0000","last_change":"2024-09-17T04:24:06.182275+0000","last_active":"2024-09-17T04:24:07.180206+0000","last_peered":"2024-09-17T04:24:07.180206+0000","last_clean":"2024-09-17T04:24:07.180206+0000","last_became_active":"2024-09-17T04:24:06.181757+0000","last_became_peered":"2024-09-17T04:24:06.181757+0000","last_unstale":"2024-09-17T04:24:07.180206+0000","last_undegraded":"2024-09-17T04:24:07.180206+0000","last_fullsized":"2024-09-17T04:24:07.180206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:09.280986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303949+0000","last_change":"2024-09-17T04:24:06.169990+0000","last_active":"2024-09-17T04:24:07.303949+0000","last_peered":"2024-09-17T04:24:07.303949+0000","last_clean":"2024-09-17T04:24:07.303949+0000","last_became_active":"2024-09-17T04:24:06.169555+0000","last_became_peered":"2024-09-17T04:24:06.169555+0000","last_unstale":"2024-09-17T04:24:07.303949+0000","last_undegraded":"2024-09-17T04:24:07.303949+0000","last_fullsized":"2024-09-17T04:24:07.303949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:24.538486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062446+0000","last_change":"2024-09-17T04:24:06.183688+0000","last_active":"2024-09-17T04:24:08.062446+0000","last_peered":"2024-09-17T04:24:08.062446+0000","last_clean":"2024-09-17T04:24:08.062446+0000","last_became_active":"2024-09-17T04:24:06.183376+0000","last_became_peered":"2024-09-17T04:24:06.183376+0000","last_unstale":"2024-09-17T04:24:08.062446+0000","last_undegraded":"2024-09-17T04:24:08.062446+0000","last_fullsized":"2024-09-17T04:24:08.062446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:01.818894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303662+0000","last_change":"2024-09-17T04:24:06.179032+0000","last_active":"2024-09-17T04:24:07.303662+0000","last_peered":"2024-09-17T04:24:07.303662+0000","last_clean":"2024-09-17T04:24:07.303662+0000","last_became_active":"2024-09-17T04:24:06.178652+0000","last_became_peered":"2024-09-17T04:24:06.178652+0000","last_unstale":"2024-09-17T04:24:07.303662+0000","last_undegraded":"2024-09-17T04:24:07.303662+0000","last_fullsized":"2024-09-17T04:24:07.303662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:42.600524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985555+0000","last_change":"2024-09-17T04:24:06.169994+0000","last_active":"2024-09-17T04:24:07.985555+0000","last_peered":"2024-09-17T04:24:07.985555+0000","last_clean":"2024-09-17T04:24:07.985555+0000","last_became_active":"2024-09-17T04:24:06.169643+0000","last_became_peered":"2024-09-17T04:24:06.169643+0000","last_unstale":"2024-09-17T04:24:07.985555+0000","last_undegraded":"2024-09-17T04:24:07.985555+0000","last_fullsized":"2024-09-17T04:24:07.985555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:53.854624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062640+0000","last_change":"2024-09-17T04:24:05.170377+0000","last_active":"2024-09-17T04:24:08.062640+0000","last_peered":"2024-09-17T04:24:08.062640+0000","last_clean":"2024-09-17T04:24:08.062640+0000","last_became_active":"2024-09-17T04:24:05.169999+0000","last_became_peered":"2024-09-17T04:24:05.169999+0000","last_unstale":"2024-09-17T04:24:08.062640+0000","last_undegraded":"2024-09-17T04:24:08.062640+0000","last_fullsized":"2024-09-17T04:24:08.062640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:35.323365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062532+0000","last_change":"2024-09-17T04:24:06.170267+0000","last_active":"2024-09-17T04:24:08.062532+0000","last_peered":"2024-09-17T04:24:08.062532+0000","last_clean":"2024-09-17T04:24:08.062532+0000","last_became_active":"2024-09-17T04:24:06.168841+0000","last_became_peered":"2024-09-17T04:24:06.168841+0000","last_unstale":"2024-09-17T04:24:08.062532+0000","last_undegraded":"2024-09-17T04:24:08.062532+0000","last_fullsized":"2024-09-17T04:24:08.062532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:27.122698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985342+0000","last_change":"2024-09-17T04:24:05.180742+0000","last_active":"2024-09-17T04:24:07.985342+0000","last_peered":"2024-09-17T04:24:07.985342+0000","last_clean":"2024-09-17T04:24:07.985342+0000","last_became_active":"2024-09-17T04:24:05.180358+0000","last_became_peered":"2024-09-17T04:24:05.180358+0000","last_unstale":"2024-09-17T04:24:07.985342+0000","last_undegraded":"2024-09-17T04:24:07.985342+0000","last_fullsized":"2024-09-17T04:24:07.985342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:25.549450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179583+0000","last_change":"2024-09-17T04:24:06.191145+0000","last_active":"2024-09-17T04:24:07.179583+0000","last_peered":"2024-09-17T04:24:07.179583+0000","last_clean":"2024-09-17T04:24:07.179583+0000","last_became_active":"2024-09-17T04:24:06.190882+0000","last_became_peered":"2024-09-17T04:24:06.190882+0000","last_unstale":"2024-09-17T04:24:07.179583+0000","last_undegraded":"2024-09-17T04:24:07.179583+0000","last_fullsized":"2024-09-17T04:24:07.179583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:38.962274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176192+0000","last_change":"2024-09-17T04:24:05.178044+0000","last_active":"2024-09-17T04:24:07.176192+0000","last_peered":"2024-09-17T04:24:07.176192+0000","last_clean":"2024-09-17T04:24:07.176192+0000","last_became_active":"2024-09-17T04:24:05.177651+0000","last_became_peered":"2024-09-17T04:24:05.177651+0000","last_unstale":"2024-09-17T04:24:07.176192+0000","last_undegraded":"2024-09-17T04:24:07.176192+0000","last_fullsized":"2024-09-17T04:24:07.176192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:36.687260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187852+0000","last_change":"2024-09-17T04:24:06.180403+0000","last_active":"2024-09-17T04:24:06.187852+0000","last_peered":"2024-09-17T04:24:06.187852+0000","last_clean":"2024-09-17T04:24:06.187852+0000","last_became_active":"2024-09-17T04:24:06.180015+0000","last_became_peered":"2024-09-17T04:24:06.180015+0000","last_unstale":"2024-09-17T04:24:06.187852+0000","last_undegraded":"2024-09-17T04:24:06.187852+0000","last_fullsized":"2024-09-17T04:24:06.187852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:28.131134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.063248+0000","last_change":"2024-09-17T04:24:05.178054+0000","last_active":"2024-09-17T04:24:08.063248+0000","last_peered":"2024-09-17T04:24:08.063248+0000","last_clean":"2024-09-17T04:24:08.063248+0000","last_became_active":"2024-09-17T04:24:05.177314+0000","last_became_peered":"2024-09-17T04:24:05.177314+0000","last_unstale":"2024-09-17T04:24:08.063248+0000","last_undegraded":"2024-09-17T04:24:08.063248+0000","last_fullsized":"2024-09-17T04:24:08.063248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:19.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304075+0000","last_change":"2024-09-17T04:24:06.177395+0000","last_active":"2024-09-17T04:24:07.304075+0000","last_peered":"2024-09-17T04:24:07.304075+0000","last_clean":"2024-09-17T04:24:07.304075+0000","last_became_active":"2024-09-17T04:24:06.177075+0000","last_became_peered":"2024-09-17T04:24:06.177075+0000","last_unstale":"2024-09-17T04:24:07.304075+0000","last_undegraded":"2024-09-17T04:24:07.304075+0000","last_fullsized":"2024-09-17T04:24:07.304075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:09.294565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.180162+0000","last_change":"2024-09-17T04:24:05.172214+0000","last_active":"2024-09-17T04:24:07.180162+0000","last_peered":"2024-09-17T04:24:07.180162+0000","last_clean":"2024-09-17T04:24:07.180162+0000","last_became_active":"2024-09-17T04:24:05.171865+0000","last_became_peered":"2024-09-17T04:24:05.171865+0000","last_unstale":"2024-09-17T04:24:07.180162+0000","last_undegraded":"2024-09-17T04:24:07.180162+0000","last_fullsized":"2024-09-17T04:24:07.180162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:05.489891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.178013+0000","last_change":"2024-09-17T04:24:06.171640+0000","last_active":"2024-09-17T04:24:06.178013+0000","last_peered":"2024-09-17T04:24:06.178013+0000","last_clean":"2024-09-17T04:24:06.178013+0000","last_became_active":"2024-09-17T04:24:06.171325+0000","last_became_peered":"2024-09-17T04:24:06.171325+0000","last_unstale":"2024-09-17T04:24:06.178013+0000","last_undegraded":"2024-09-17T04:24:06.178013+0000","last_fullsized":"2024-09-17T04:24:06.178013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:59.400201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.178654+0000","last_change":"2024-09-17T04:24:05.172215+0000","last_active":"2024-09-17T04:24:07.178654+0000","last_peered":"2024-09-17T04:24:07.178654+0000","last_clean":"2024-09-17T04:24:07.178654+0000","last_became_active":"2024-09-17T04:24:05.171857+0000","last_became_peered":"2024-09-17T04:24:05.171857+0000","last_unstale":"2024-09-17T04:24:07.178654+0000","last_undegraded":"2024-09-17T04:24:07.178654+0000","last_fullsized":"2024-09-17T04:24:07.178654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:22.610758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.177974+0000","last_change":"2024-09-17T04:24:06.167035+0000","last_active":"2024-09-17T04:24:07.177974+0000","last_peered":"2024-09-17T04:24:07.177974+0000","last_clean":"2024-09-17T04:24:07.177974+0000","last_became_active":"2024-09-17T04:24:06.166623+0000","last_became_peered":"2024-09-17T04:24:06.166623+0000","last_unstale":"2024-09-17T04:24:07.177974+0000","last_undegraded":"2024-09-17T04:24:07.177974+0000","last_fullsized":"2024-09-17T04:24:07.177974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:27.122698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.175960+0000","last_change":"2024-09-17T04:24:05.172407+0000","last_active":"2024-09-17T04:24:07.175960+0000","last_peered":"2024-09-17T04:24:07.175960+0000","last_clean":"2024-09-17T04:24:07.175960+0000","last_became_active":"2024-09-17T04:24:05.172101+0000","last_became_peered":"2024-09-17T04:24:05.172101+0000","last_unstale":"2024-09-17T04:24:07.175960+0000","last_undegraded":"2024-09-17T04:24:07.175960+0000","last_fullsized":"2024-09-17T04:24:07.175960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:31.165644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187787+0000","last_change":"2024-09-17T04:24:06.183784+0000","last_active":"2024-09-17T04:24:06.187787+0000","last_peered":"2024-09-17T04:24:06.187787+0000","last_clean":"2024-09-17T04:24:06.187787+0000","last_became_active":"2024-09-17T04:24:06.183304+0000","last_became_peered":"2024-09-17T04:24:06.183304+0000","last_unstale":"2024-09-17T04:24:06.187787+0000","last_undegraded":"2024-09-17T04:24:06.187787+0000","last_fullsized":"2024-09-17T04:24:06.187787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:12.473895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.178121+0000","last_change":"2024-09-17T04:24:05.167010+0000","last_active":"2024-09-17T04:24:07.178121+0000","last_peered":"2024-09-17T04:24:07.178121+0000","last_clean":"2024-09-17T04:24:07.178121+0000","last_became_active":"2024-09-17T04:24:05.166678+0000","last_became_peered":"2024-09-17T04:24:05.166678+0000","last_unstale":"2024-09-17T04:24:07.178121+0000","last_undegraded":"2024-09-17T04:24:07.178121+0000","last_fullsized":"2024-09-17T04:24:07.178121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:12.446438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.182347+0000","last_change":"2024-09-17T04:24:06.179898+0000","last_active":"2024-09-17T04:24:06.182347+0000","last_peered":"2024-09-17T04:24:06.182347+0000","last_clean":"2024-09-17T04:24:06.182347+0000","last_became_active":"2024-09-17T04:24:06.179593+0000","last_became_peered":"2024-09-17T04:24:06.179593+0000","last_unstale":"2024-09-17T04:24:06.182347+0000","last_undegraded":"2024-09-17T04:24:06.182347+0000","last_fullsized":"2024-09-17T04:24:06.182347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:19.233966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176648+0000","last_change":"2024-09-17T04:24:05.175504+0000","last_active":"2024-09-17T04:24:07.176648+0000","last_peered":"2024-09-17T04:24:07.176648+0000","last_clean":"2024-09-17T04:24:07.176648+0000","last_became_active":"2024-09-17T04:24:05.175044+0000","last_became_peered":"2024-09-17T04:24:05.175044+0000","last_unstale":"2024-09-17T04:24:07.176648+0000","last_undegraded":"2024-09-17T04:24:07.176648+0000","last_fullsized":"2024-09-17T04:24:07.176648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:27.351631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176768+0000","last_change":"2024-09-17T04:24:06.191364+0000","last_active":"2024-09-17T04:24:07.176768+0000","last_peered":"2024-09-17T04:24:07.176768+0000","last_clean":"2024-09-17T04:24:07.176768+0000","last_became_active":"2024-09-17T04:24:06.191027+0000","last_became_peered":"2024-09-17T04:24:06.191027+0000","last_unstale":"2024-09-17T04:24:07.176768+0000","last_undegraded":"2024-09-17T04:24:07.176768+0000","last_fullsized":"2024-09-17T04:24:07.176768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:21.610365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985441+0000","last_change":"2024-09-17T04:24:05.175528+0000","last_active":"2024-09-17T04:24:07.985441+0000","last_peered":"2024-09-17T04:24:07.985441+0000","last_clean":"2024-09-17T04:24:07.985441+0000","last_became_active":"2024-09-17T04:24:05.174699+0000","last_became_peered":"2024-09-17T04:24:05.174699+0000","last_unstale":"2024-09-17T04:24:07.985441+0000","last_undegraded":"2024-09-17T04:24:07.985441+0000","last_fullsized":"2024-09-17T04:24:07.985441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:40.466322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176497+0000","last_change":"2024-09-17T04:24:06.190330+0000","last_active":"2024-09-17T04:24:07.176497+0000","last_peered":"2024-09-17T04:24:07.176497+0000","last_clean":"2024-09-17T04:24:07.176497+0000","last_became_active":"2024-09-17T04:24:06.189617+0000","last_became_peered":"2024-09-17T04:24:06.189617+0000","last_unstale":"2024-09-17T04:24:07.176497+0000","last_undegraded":"2024-09-17T04:24:07.176497+0000","last_fullsized":"2024-09-17T04:24:07.176497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:17.386514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.178894+0000","last_change":"2024-09-17T04:24:05.170882+0000","last_active":"2024-09-17T04:24:06.178894+0000","last_peered":"2024-09-17T04:24:06.178894+0000","last_clean":"2024-09-17T04:24:06.178894+0000","last_became_active":"2024-09-17T04:24:05.170537+0000","last_became_peered":"2024-09-17T04:24:05.170537+0000","last_unstale":"2024-09-17T04:24:06.178894+0000","last_undegraded":"2024-09-17T04:24:06.178894+0000","last_fullsized":"2024-09-17T04:24:06.178894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:41.524656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184361+0000","last_change":"2024-09-17T04:24:06.182372+0000","last_active":"2024-09-17T04:24:06.184361+0000","last_peered":"2024-09-17T04:24:06.184361+0000","last_clean":"2024-09-17T04:24:06.184361+0000","last_became_active":"2024-09-17T04:24:06.182066+0000","last_became_peered":"2024-09-17T04:24:06.182066+0000","last_unstale":"2024-09-17T04:24:06.184361+0000","last_undegraded":"2024-09-17T04:24:06.184361+0000","last_fullsized":"2024-09-17T04:24:06.184361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:43.638743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176537+0000","last_change":"2024-09-17T04:24:05.170671+0000","last_active":"2024-09-17T04:24:07.176537+0000","last_peered":"2024-09-17T04:24:07.176537+0000","last_clean":"2024-09-17T04:24:07.176537+0000","last_became_active":"2024-09-17T04:24:05.170364+0000","last_became_peered":"2024-09-17T04:24:05.170364+0000","last_unstale":"2024-09-17T04:24:07.176537+0000","last_undegraded":"2024-09-17T04:24:07.176537+0000","last_fullsized":"2024-09-17T04:24:07.176537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:35.718831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.188790+0000","last_change":"2024-09-17T04:24:06.184296+0000","last_active":"2024-09-17T04:24:06.188790+0000","last_peered":"2024-09-17T04:24:06.188790+0000","last_clean":"2024-09-17T04:24:06.188790+0000","last_became_active":"2024-09-17T04:24:06.182930+0000","last_became_peered":"2024-09-17T04:24:06.182930+0000","last_unstale":"2024-09-17T04:24:06.188790+0000","last_undegraded":"2024-09-17T04:24:06.188790+0000","last_fullsized":"2024-09-17T04:24:06.188790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:40.193138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.180300+0000","last_change":"2024-09-17T04:24:05.166714+0000","last_active":"2024-09-17T04:24:07.180300+0000","last_peered":"2024-09-17T04:24:07.180300+0000","last_clean":"2024-09-17T04:24:07.180300+0000","last_became_active":"2024-09-17T04:24:05.166354+0000","last_became_peered":"2024-09-17T04:24:05.166354+0000","last_unstale":"2024-09-17T04:24:07.180300+0000","last_undegraded":"2024-09-17T04:24:07.180300+0000","last_fullsized":"2024-09-17T04:24:07.180300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.486046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176258+0000","last_change":"2024-09-17T04:24:06.187448+0000","last_active":"2024-09-17T04:24:07.176258+0000","last_peered":"2024-09-17T04:24:07.176258+0000","last_clean":"2024-09-17T04:24:07.176258+0000","last_became_active":"2024-09-17T04:24:06.186751+0000","last_became_peered":"2024-09-17T04:24:06.186751+0000","last_unstale":"2024-09-17T04:24:07.176258+0000","last_undegraded":"2024-09-17T04:24:07.176258+0000","last_fullsized":"2024-09-17T04:24:07.176258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:41.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.171681+0000","last_change":"2024-09-17T04:24:05.167419+0000","last_active":"2024-09-17T04:24:06.171681+0000","last_peered":"2024-09-17T04:24:06.171681+0000","last_clean":"2024-09-17T04:24:06.171681+0000","last_became_active":"2024-09-17T04:24:05.166636+0000","last_became_peered":"2024-09-17T04:24:05.166636+0000","last_unstale":"2024-09-17T04:24:06.171681+0000","last_undegraded":"2024-09-17T04:24:06.171681+0000","last_fullsized":"2024-09-17T04:24:06.171681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:35.920064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304095+0000","last_change":"2024-09-17T04:24:06.178297+0000","last_active":"2024-09-17T04:24:07.304095+0000","last_peered":"2024-09-17T04:24:07.304095+0000","last_clean":"2024-09-17T04:24:07.304095+0000","last_became_active":"2024-09-17T04:24:06.177962+0000","last_became_peered":"2024-09-17T04:24:06.177962+0000","last_unstale":"2024-09-17T04:24:07.304095+0000","last_undegraded":"2024-09-17T04:24:07.304095+0000","last_fullsized":"2024-09-17T04:24:07.304095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176004+0000","last_change":"2024-09-17T04:24:05.171616+0000","last_active":"2024-09-17T04:24:07.176004+0000","last_peered":"2024-09-17T04:24:07.176004+0000","last_clean":"2024-09-17T04:24:07.176004+0000","last_became_active":"2024-09-17T04:24:05.171304+0000","last_became_peered":"2024-09-17T04:24:05.171304+0000","last_unstale":"2024-09-17T04:24:07.176004+0000","last_undegraded":"2024-09-17T04:24:07.176004+0000","last_fullsized":"2024-09-17T04:24:07.176004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:01.612475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062575+0000","last_change":"2024-09-17T04:24:06.169481+0000","last_active":"2024-09-17T04:24:08.062575+0000","last_peered":"2024-09-17T04:24:08.062575+0000","last_clean":"2024-09-17T04:24:08.062575+0000","last_became_active":"2024-09-17T04:24:06.169151+0000","last_became_peered":"2024-09-17T04:24:06.169151+0000","last_unstale":"2024-09-17T04:24:08.062575+0000","last_undegraded":"2024-09-17T04:24:08.062575+0000","last_fullsized":"2024-09-17T04:24:08.062575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:34.696656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176351+0000","last_change":"2024-09-17T04:24:05.177682+0000","last_active":"2024-09-17T04:24:07.176351+0000","last_peered":"2024-09-17T04:24:07.176351+0000","last_clean":"2024-09-17T04:24:07.176351+0000","last_became_active":"2024-09-17T04:24:05.177292+0000","last_became_peered":"2024-09-17T04:24:05.177292+0000","last_unstale":"2024-09-17T04:24:07.176351+0000","last_undegraded":"2024-09-17T04:24:07.176351+0000","last_fullsized":"2024-09-17T04:24:07.176351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:52.164308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179154+0000","last_change":"2024-09-17T04:24:06.166957+0000","last_active":"2024-09-17T04:24:07.179154+0000","last_peered":"2024-09-17T04:24:07.179154+0000","last_clean":"2024-09-17T04:24:07.179154+0000","last_became_active":"2024-09-17T04:24:06.166562+0000","last_became_peered":"2024-09-17T04:24:06.166562+0000","last_unstale":"2024-09-17T04:24:07.179154+0000","last_undegraded":"2024-09-17T04:24:07.179154+0000","last_fullsized":"2024-09-17T04:24:07.179154+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:52.499922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.193725+0000","last_change":"2024-09-17T04:24:05.171787+0000","last_active":"2024-09-17T04:24:06.193725+0000","last_peered":"2024-09-17T04:24:06.193725+0000","last_clean":"2024-09-17T04:24:06.193725+0000","last_became_active":"2024-09-17T04:24:05.171468+0000","last_became_peered":"2024-09-17T04:24:05.171468+0000","last_unstale":"2024-09-17T04:24:06.193725+0000","last_undegraded":"2024-09-17T04:24:06.193725+0000","last_fullsized":"2024-09-17T04:24:06.193725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:50.770483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.176466+0000","last_change":"2024-09-17T04:24:06.170829+0000","last_active":"2024-09-17T04:24:06.176466+0000","last_peered":"2024-09-17T04:24:06.176466+0000","last_clean":"2024-09-17T04:24:06.176466+0000","last_became_active":"2024-09-17T04:24:06.169177+0000","last_became_peered":"2024-09-17T04:24:06.169177+0000","last_unstale":"2024-09-17T04:24:06.176466+0000","last_undegraded":"2024-09-17T04:24:06.176466+0000","last_fullsized":"2024-09-17T04:24:06.176466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:40.325611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179295+0000","last_change":"2024-09-17T04:24:05.166720+0000","last_active":"2024-09-17T04:24:07.179295+0000","last_peered":"2024-09-17T04:24:07.179295+0000","last_clean":"2024-09-17T04:24:07.179295+0000","last_became_active":"2024-09-17T04:24:05.166315+0000","last_became_peered":"2024-09-17T04:24:05.166315+0000","last_unstale":"2024-09-17T04:24:07.179295+0000","last_undegraded":"2024-09-17T04:24:07.179295+0000","last_fullsized":"2024-09-17T04:24:07.179295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:34.489856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187759+0000","last_change":"2024-09-17T04:24:06.183604+0000","last_active":"2024-09-17T04:24:06.187759+0000","last_peered":"2024-09-17T04:24:06.187759+0000","last_clean":"2024-09-17T04:24:06.187759+0000","last_became_active":"2024-09-17T04:24:06.183274+0000","last_became_peered":"2024-09-17T04:24:06.183274+0000","last_unstale":"2024-09-17T04:24:06.187759+0000","last_undegraded":"2024-09-17T04:24:06.187759+0000","last_fullsized":"2024-09-17T04:24:06.187759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:02.991394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179337+0000","last_change":"2024-09-17T04:24:05.170936+0000","last_active":"2024-09-17T04:24:07.179337+0000","last_peered":"2024-09-17T04:24:07.179337+0000","last_clean":"2024-09-17T04:24:07.179337+0000","last_became_active":"2024-09-17T04:24:05.170477+0000","last_became_peered":"2024-09-17T04:24:05.170477+0000","last_unstale":"2024-09-17T04:24:07.179337+0000","last_undegraded":"2024-09-17T04:24:07.179337+0000","last_fullsized":"2024-09-17T04:24:07.179337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:34.422458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062959+0000","last_change":"2024-09-17T04:24:06.180406+0000","last_active":"2024-09-17T04:24:08.062959+0000","last_peered":"2024-09-17T04:24:08.062959+0000","last_clean":"2024-09-17T04:24:08.062959+0000","last_became_active":"2024-09-17T04:24:06.180115+0000","last_became_peered":"2024-09-17T04:24:06.180115+0000","last_unstale":"2024-09-17T04:24:08.062959+0000","last_undegraded":"2024-09-17T04:24:08.062959+0000","last_fullsized":"2024-09-17T04:24:08.062959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:20.916280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.179716+0000","last_change":"2024-09-17T04:24:05.175413+0000","last_active":"2024-09-17T04:24:07.179716+0000","last_peered":"2024-09-17T04:24:07.179716+0000","last_clean":"2024-09-17T04:24:07.179716+0000","last_became_active":"2024-09-17T04:24:05.174892+0000","last_became_peered":"2024-09-17T04:24:05.174892+0000","last_unstale":"2024-09-17T04:24:07.179716+0000","last_undegraded":"2024-09-17T04:24:07.179716+0000","last_fullsized":"2024-09-17T04:24:07.179716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:36.414877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.063203+0000","last_change":"2024-09-17T04:24:06.174010+0000","last_active":"2024-09-17T04:24:08.063203+0000","last_peered":"2024-09-17T04:24:08.063203+0000","last_clean":"2024-09-17T04:24:08.063203+0000","last_became_active":"2024-09-17T04:24:06.173703+0000","last_became_peered":"2024-09-17T04:24:06.173703+0000","last_unstale":"2024-09-17T04:24:08.063203+0000","last_undegraded":"2024-09-17T04:24:08.063203+0000","last_fullsized":"2024-09-17T04:24:08.063203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:35.430394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985495+0000","last_change":"2024-09-17T04:24:05.169814+0000","last_active":"2024-09-17T04:24:07.985495+0000","last_peered":"2024-09-17T04:24:07.985495+0000","last_clean":"2024-09-17T04:24:07.985495+0000","last_became_active":"2024-09-17T04:24:05.169450+0000","last_became_peered":"2024-09-17T04:24:05.169450+0000","last_unstale":"2024-09-17T04:24:07.985495+0000","last_undegraded":"2024-09-17T04:24:07.985495+0000","last_fullsized":"2024-09-17T04:24:07.985495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:35.323365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.063095+0000","last_change":"2024-09-17T04:24:06.173191+0000","last_active":"2024-09-17T04:24:08.063095+0000","last_peered":"2024-09-17T04:24:08.063095+0000","last_clean":"2024-09-17T04:24:08.063095+0000","last_became_active":"2024-09-17T04:24:06.172865+0000","last_became_peered":"2024-09-17T04:24:06.172865+0000","last_unstale":"2024-09-17T04:24:08.063095+0000","last_undegraded":"2024-09-17T04:24:08.063095+0000","last_fullsized":"2024-09-17T04:24:08.063095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:26.947647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062298+0000","last_change":"2024-09-17T04:24:05.173932+0000","last_active":"2024-09-17T04:24:08.062298+0000","last_peered":"2024-09-17T04:24:08.062298+0000","last_clean":"2024-09-17T04:24:08.062298+0000","last_became_active":"2024-09-17T04:24:05.173627+0000","last_became_peered":"2024-09-17T04:24:05.173627+0000","last_unstale":"2024-09-17T04:24:08.062298+0000","last_undegraded":"2024-09-17T04:24:08.062298+0000","last_fullsized":"2024-09-17T04:24:08.062298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:36.414877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062650+0000","last_change":"2024-09-17T04:24:06.179699+0000","last_active":"2024-09-17T04:24:08.062650+0000","last_peered":"2024-09-17T04:24:08.062650+0000","last_clean":"2024-09-17T04:24:08.062650+0000","last_became_active":"2024-09-17T04:24:06.179185+0000","last_became_peered":"2024-09-17T04:24:06.179185+0000","last_unstale":"2024-09-17T04:24:08.062650+0000","last_undegraded":"2024-09-17T04:24:08.062650+0000","last_fullsized":"2024-09-17T04:24:08.062650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:01.364044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.178133+0000","last_change":"2024-09-17T04:24:05.178284+0000","last_active":"2024-09-17T04:24:07.178133+0000","last_peered":"2024-09-17T04:24:07.178133+0000","last_clean":"2024-09-17T04:24:07.178133+0000","last_became_active":"2024-09-17T04:24:05.177949+0000","last_became_peered":"2024-09-17T04:24:05.177949+0000","last_unstale":"2024-09-17T04:24:07.178133+0000","last_undegraded":"2024-09-17T04:24:07.178133+0000","last_fullsized":"2024-09-17T04:24:07.178133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:13.739259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.303840+0000","last_change":"2024-09-17T04:24:06.172372+0000","last_active":"2024-09-17T04:24:07.303840+0000","last_peered":"2024-09-17T04:24:07.303840+0000","last_clean":"2024-09-17T04:24:07.303840+0000","last_became_active":"2024-09-17T04:24:06.172068+0000","last_became_peered":"2024-09-17T04:24:06.172068+0000","last_unstale":"2024-09-17T04:24:07.303840+0000","last_undegraded":"2024-09-17T04:24:07.303840+0000","last_fullsized":"2024-09-17T04:24:07.303840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:07.624567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.162170+0000","last_change":"2024-09-17T04:24:05.175432+0000","last_active":"2024-09-17T04:24:06.162170+0000","last_peered":"2024-09-17T04:24:06.162170+0000","last_clean":"2024-09-17T04:24:06.162170+0000","last_became_active":"2024-09-17T04:24:05.175015+0000","last_became_peered":"2024-09-17T04:24:05.175015+0000","last_unstale":"2024-09-17T04:24:06.162170+0000","last_undegraded":"2024-09-17T04:24:06.162170+0000","last_fullsized":"2024-09-17T04:24:06.162170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:01.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062848+0000","last_change":"2024-09-17T04:24:06.176070+0000","last_active":"2024-09-17T04:24:08.062848+0000","last_peered":"2024-09-17T04:24:08.062848+0000","last_clean":"2024-09-17T04:24:08.062848+0000","last_became_active":"2024-09-17T04:24:06.175712+0000","last_became_peered":"2024-09-17T04:24:06.175712+0000","last_unstale":"2024-09-17T04:24:08.062848+0000","last_undegraded":"2024-09-17T04:24:08.062848+0000","last_fullsized":"2024-09-17T04:24:08.062848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:06.750787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.187601+0000","last_change":"2024-09-17T04:24:05.172564+0000","last_active":"2024-09-17T04:24:06.187601+0000","last_peered":"2024-09-17T04:24:06.187601+0000","last_clean":"2024-09-17T04:24:06.187601+0000","last_became_active":"2024-09-17T04:24:05.172236+0000","last_became_peered":"2024-09-17T04:24:05.172236+0000","last_unstale":"2024-09-17T04:24:06.187601+0000","last_undegraded":"2024-09-17T04:24:06.187601+0000","last_fullsized":"2024-09-17T04:24:06.187601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:10.151102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.184418+0000","last_change":"2024-09-17T04:24:06.182541+0000","last_active":"2024-09-17T04:24:06.184418+0000","last_peered":"2024-09-17T04:24:06.184418+0000","last_clean":"2024-09-17T04:24:06.184418+0000","last_became_active":"2024-09-17T04:24:06.182177+0000","last_became_peered":"2024-09-17T04:24:06.182177+0000","last_unstale":"2024-09-17T04:24:06.184418+0000","last_undegraded":"2024-09-17T04:24:06.184418+0000","last_fullsized":"2024-09-17T04:24:06.184418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:39.052827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.159157+0000","last_change":"2024-09-17T04:24:05.170982+0000","last_active":"2024-09-17T04:24:08.159157+0000","last_peered":"2024-09-17T04:24:08.159157+0000","last_clean":"2024-09-17T04:24:08.159157+0000","last_became_active":"2024-09-17T04:24:05.170649+0000","last_became_peered":"2024-09-17T04:24:05.170649+0000","last_unstale":"2024-09-17T04:24:08.159157+0000","last_undegraded":"2024-09-17T04:24:08.159157+0000","last_fullsized":"2024-09-17T04:24:08.159157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:20.874125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985433+0000","last_change":"2024-09-17T04:24:06.180598+0000","last_active":"2024-09-17T04:24:07.985433+0000","last_peered":"2024-09-17T04:24:07.985433+0000","last_clean":"2024-09-17T04:24:07.985433+0000","last_became_active":"2024-09-17T04:24:06.180258+0000","last_became_peered":"2024-09-17T04:24:06.180258+0000","last_unstale":"2024-09-17T04:24:07.985433+0000","last_undegraded":"2024-09-17T04:24:07.985433+0000","last_fullsized":"2024-09-17T04:24:07.985433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:40.580498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.174562+0000","last_change":"2024-09-17T04:24:05.171231+0000","last_active":"2024-09-17T04:24:06.174562+0000","last_peered":"2024-09-17T04:24:06.174562+0000","last_clean":"2024-09-17T04:24:06.174562+0000","last_became_active":"2024-09-17T04:24:05.170941+0000","last_became_peered":"2024-09-17T04:24:05.170941+0000","last_unstale":"2024-09-17T04:24:06.174562+0000","last_undegraded":"2024-09-17T04:24:06.174562+0000","last_fullsized":"2024-09-17T04:24:06.174562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:17.999891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062491+0000","last_change":"2024-09-17T04:24:06.172715+0000","last_active":"2024-09-17T04:24:08.062491+0000","last_peered":"2024-09-17T04:24:08.062491+0000","last_clean":"2024-09-17T04:24:08.062491+0000","last_became_active":"2024-09-17T04:24:06.172411+0000","last_became_peered":"2024-09-17T04:24:06.172411+0000","last_unstale":"2024-09-17T04:24:08.062491+0000","last_undegraded":"2024-09-17T04:24:08.062491+0000","last_fullsized":"2024-09-17T04:24:08.062491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:32.333123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985587+0000","last_change":"2024-09-17T04:24:05.163707+0000","last_active":"2024-09-17T04:24:07.985587+0000","last_peered":"2024-09-17T04:24:07.985587+0000","last_clean":"2024-09-17T04:24:07.985587+0000","last_became_active":"2024-09-17T04:24:05.163384+0000","last_became_peered":"2024-09-17T04:24:05.163384+0000","last_unstale":"2024-09-17T04:24:07.985587+0000","last_undegraded":"2024-09-17T04:24:07.985587+0000","last_fullsized":"2024-09-17T04:24:07.985587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.159212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.985421+0000","last_change":"2024-09-17T04:24:06.168439+0000","last_active":"2024-09-17T04:24:07.985421+0000","last_peered":"2024-09-17T04:24:07.985421+0000","last_clean":"2024-09-17T04:24:07.985421+0000","last_became_active":"2024-09-17T04:24:06.168008+0000","last_became_peered":"2024-09-17T04:24:06.168008+0000","last_unstale":"2024-09-17T04:24:07.985421+0000","last_undegraded":"2024-09-17T04:24:07.985421+0000","last_fullsized":"2024-09-17T04:24:07.985421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:52.499922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T04:24:06.171765+0000","last_change":"2024-09-17T04:24:05.172804+0000","last_active":"2024-09-17T04:24:06.171765+0000","last_peered":"2024-09-17T04:24:06.171765+0000","last_clean":"2024-09-17T04:24:06.171765+0000","last_became_active":"2024-09-17T04:24:05.172497+0000","last_became_peered":"2024-09-17T04:24:05.172497+0000","last_unstale":"2024-09-17T04:24:06.171765+0000","last_undegraded":"2024-09-17T04:24:06.171765+0000","last_fullsized":"2024-09-17T04:24:06.171765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:10.662887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.175994+0000","last_change":"2024-09-17T04:24:06.193191+0000","last_active":"2024-09-17T04:24:07.175994+0000","last_peered":"2024-09-17T04:24:07.175994+0000","last_clean":"2024-09-17T04:24:07.175994+0000","last_became_active":"2024-09-17T04:24:06.192390+0000","last_became_peered":"2024-09-17T04:24:06.192390+0000","last_unstale":"2024-09-17T04:24:07.175994+0000","last_undegraded":"2024-09-17T04:24:07.175994+0000","last_fullsized":"2024-09-17T04:24:07.175994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:53.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.178237+0000","last_change":"2024-09-17T04:24:05.164194+0000","last_active":"2024-09-17T04:24:07.178237+0000","last_peered":"2024-09-17T04:24:07.178237+0000","last_clean":"2024-09-17T04:24:07.178237+0000","last_became_active":"2024-09-17T04:24:05.163797+0000","last_became_peered":"2024-09-17T04:24:05.163797+0000","last_unstale":"2024-09-17T04:24:07.178237+0000","last_undegraded":"2024-09-17T04:24:07.178237+0000","last_fullsized":"2024-09-17T04:24:07.178237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:10.934446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.177979+0000","last_change":"2024-09-17T04:24:06.189961+0000","last_active":"2024-09-17T04:24:07.177979+0000","last_peered":"2024-09-17T04:24:07.177979+0000","last_clean":"2024-09-17T04:24:07.177979+0000","last_became_active":"2024-09-17T04:24:06.189671+0000","last_became_peered":"2024-09-17T04:24:06.189671+0000","last_unstale":"2024-09-17T04:24:07.177979+0000","last_undegraded":"2024-09-17T04:24:07.177979+0000","last_fullsized":"2024-09-17T04:24:07.177979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:02.620411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.176111+0000","last_change":"2024-09-17T04:24:05.180480+0000","last_active":"2024-09-17T04:24:07.176111+0000","last_peered":"2024-09-17T04:24:07.176111+0000","last_clean":"2024-09-17T04:24:07.176111+0000","last_became_active":"2024-09-17T04:24:05.180155+0000","last_became_peered":"2024-09-17T04:24:05.180155+0000","last_unstale":"2024-09-17T04:24:07.176111+0000","last_undegraded":"2024-09-17T04:24:07.176111+0000","last_fullsized":"2024-09-17T04:24:07.176111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:39.572561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304423+0000","last_change":"2024-09-17T04:24:06.184402+0000","last_active":"2024-09-17T04:24:07.304423+0000","last_peered":"2024-09-17T04:24:07.304423+0000","last_clean":"2024-09-17T04:24:07.304423+0000","last_became_active":"2024-09-17T04:24:06.184128+0000","last_became_peered":"2024-09-17T04:24:06.184128+0000","last_unstale":"2024-09-17T04:24:07.304423+0000","last_undegraded":"2024-09-17T04:24:07.304423+0000","last_fullsized":"2024-09-17T04:24:07.304423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:05.143106+0000","last_clean_scrub_stamp":"2024-09-17T04:24:05.143106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:20.254266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:08.062405+0000","last_change":"2024-09-17T04:24:05.173334+0000","last_active":"2024-09-17T04:24:08.062405+0000","last_peered":"2024-09-17T04:24:08.062405+0000","last_clean":"2024-09-17T04:24:08.062405+0000","last_became_active":"2024-09-17T04:24:05.172962+0000","last_became_peered":"2024-09-17T04:24:05.172962+0000","last_unstale":"2024-09-17T04:24:08.062405+0000","last_undegraded":"2024-09-17T04:24:08.062405+0000","last_fullsized":"2024-09-17T04:24:08.062405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:24:04.135170+0000","last_clean_scrub_stamp":"2024-09-17T04:24:04.135170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.486046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304179+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:24:07.304179+0000","last_peered":"2024-09-17T04:24:07.304179+0000","last_clean":"2024-09-17T04:24:07.304179+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:24:07.304179+0000","last_undegraded":"2024-09-17T04:24:07.304179+0000","last_fullsized":"2024-09-17T04:24:07.304179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":360448,"data_stored":136043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":137573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":726307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":130311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":131273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:24:10.602 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:24:10.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 -- 172.21.15.63:0/2501932058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4004020 msgr2=0x7fc9b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 --2- 172.21.15.63:0/2501932058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b4004020 0x7fc9b4004800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009b20 tx=0x7fc9b4005830 comp rx=0 tx=0).stop 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9c77fe640 1 -- 172.21.15.63:0/2501932058 reap_dead start 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 -- 172.21.15.63:0/2501932058 shutdown_connections 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 -- 172.21.15.63:0/2501932058 >> 172.21.15.63:0/2501932058 conn(0x7fc9c808bfc0 msgr2=0x7fc9c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 -- 172.21.15.63:0/2501932058 shutdown_connections 2024-09-17T04:24:10.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.764+0000 7fc9cd870640 1 -- 172.21.15.63:0/2501932058 wait complete. 2024-09-17T04:24:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.766+0000 7fc9cd870640 1 Processor -- start 2024-09-17T04:24:10.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.766+0000 7fc9cd870640 1 -- start start 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9b4004020 0x7fc9c8151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9c80c8290 0x7fc9c80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c80cf200 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c80cf080 con 0x7fc9b4004020 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9cd870640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c80cf380 con 0x7fc9c80c8290 2024-09-17T04:24:10.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55762/0 (socket says 172.21.15.63:55762) 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9c77fe640 1 -- 172.21.15.63:0/3137672752 learned_addr learned my addr 172.21.15.63:0/3137672752 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9c67fc640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9c80c8290 0x7fc9c80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.767+0000 7fc9c6ffd640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9b4004020 0x7fc9c8151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 -- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9c80c8290 msgr2=0x7fc9c80ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9c80c8290 0x7fc9c80ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 -- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9b4004020 msgr2=0x7fc9c8151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9b4004020 0x7fc9c8151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 -- 172.21.15.63:0/3137672752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c80ce940 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9c77fe640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ba0d0 tx=0x7fc9c0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c001f070 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c000fb20 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c81f9420 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0012450 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.768+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c80c8d10 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.769+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c80c87a0 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.770+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9c0022070 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.770+0000 7fc9bffff640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:10.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.771+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc9c009b560 con 0x7fc9c81f8ad0 2024-09-17T04:24:10.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.771+0000 7fc9c6ffd640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:10.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.771+0000 7fc9c6ffd640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006fd0 tx=0x7fc9b8003e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:10.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:10.775+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9c81f9420 con 0x7fc9c81f8ad0 2024-09-17T04:24:11.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.035+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc9c80c9710 con 0x7fc9c81f8ad0 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.038+0000 7fc9bffff640 1 -- 172.21.15.63:0/3137672752 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fc9c80ce940 con 0x7fc9c81f8ad0 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAABOlmlR9ZAxAAdELUblUr9QUs6iP5eoCjMw== 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: caps mds = "allow" 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: caps mon = "allow r" 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T04:24:11.038 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.040+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 msgr2=0x7fc9a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.040+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8006fd0 tx=0x7fc9b8003e00 comp rx=0 tx=0).stop 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 msgr2=0x7fc9c81f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80ba0d0 tx=0x7fc9c0011b10 comp rx=0 tx=0).stop 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 shutdown_connections 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc9a8078bc0 0x7fc9a807b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c81f8ad0 0x7fc9c81f8ee0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc9c80c8290 0x7fc9c80ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 --2- 172.21.15.63:0/3137672752 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc9b4004020 0x7fc9c8151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 >> 172.21.15.63:0/3137672752 conn(0x7fc9c808bfc0 msgr2=0x7fc9c80d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 shutdown_connections 2024-09-17T04:24:11.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.041+0000 7fc9cd870640 1 -- 172.21.15.63:0/3137672752 wait complete. 2024-09-17T04:24:11.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:24:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 -- 172.21.15.63:0/2744652479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe22c003c30 msgr2=0x7fe22c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 --2- 172.21.15.63:0/2744652479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe22c003c30 0x7fe22c004080 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe234006fa0 tx=0x7fe22c005830 comp rx=0 tx=0).stop 2024-09-17T04:24:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 -- 172.21.15.63:0/2744652479 shutdown_connections 2024-09-17T04:24:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 --2- 172.21.15.63:0/2744652479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe22c003c30 0x7fe22c004080 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 -- 172.21.15.63:0/2744652479 >> 172.21.15.63:0/2744652479 conn(0x7fe24409d870 msgr2=0x7fe2440d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 -- 172.21.15.63:0/2744652479 shutdown_connections 2024-09-17T04:24:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.170+0000 7fe24c390640 1 -- 172.21.15.63:0/2744652479 wait complete. 2024-09-17T04:24:11.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.172+0000 7fe24c390640 1 Processor -- start 2024-09-17T04:24:11.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.172+0000 7fe24c390640 1 -- start start 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c003c30 0x7fe24406f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2440b3f80 0x7fe2440b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440b6120 con 0x7fe2440ca4a0 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440b5fa0 con 0x7fe2440b3f80 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.173+0000 7fe24c390640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440b62a0 con 0x7fe22c003c30 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55778/0 (socket says 172.21.15.63:55778) 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 -- 172.21.15.63:0/326714839 learned_addr learned my addr 172.21.15.63:0/326714839 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24a12c640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c003c30 0x7fe24406f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24a92d640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2440b3f80 0x7fe2440b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 -- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c003c30 msgr2=0x7fe24406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c003c30 0x7fe24406f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 -- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2440b3f80 msgr2=0x7fe2440b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2440b3f80 0x7fe2440b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 -- 172.21.15.63:0/326714839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440b48d0 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24992b640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe238010d70 tx=0x7fe23800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238017070 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe238011730 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2441f5230 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe238011b60 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.174+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441f57f0 con 0x7fe2440ca4a0 2024-09-17T04:24:11.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.175+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2440cae60 con 0x7fe2440ca4a0 2024-09-17T04:24:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.176+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe238011d00 con 0x7fe2440ca4a0 2024-09-17T04:24:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.177+0000 7fe242ffd640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 0x7fe23007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.177+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe23809ba90 con 0x7fe2440ca4a0 2024-09-17T04:24:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.177+0000 7fe24a12c640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 0x7fe23007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.178+0000 7fe24a12c640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 0x7fe23007b100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe234033000 tx=0x7fe23402d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.181+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2440b48d0 con 0x7fe2440ca4a0 2024-09-17T04:24:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.403+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2440b6800 con 0x7fe2440ca4a0 2024-09-17T04:24:11.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.404+0000 7fe242ffd640 1 -- 172.21.15.63:0/326714839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7fe238063f60 con 0x7fe2440ca4a0 2024-09-17T04:24:11.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:11.404 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:24:11.404 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 msgr2=0x7fe23007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 0x7fe23007b100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe234033000 tx=0x7fe23402d000 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 msgr2=0x7fe2440ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe238010d70 tx=0x7fe23800e720 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 shutdown_connections 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fe230078bf0 0x7fe23007b100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fe2440b3f80 0x7fe2440b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2440ca4a0 0x7fe2440ca8b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 --2- 172.21.15.63:0/326714839 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fe22c003c30 0x7fe24406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 >> 172.21.15.63:0/326714839 conn(0x7fe24409d870 msgr2=0x7fe24415eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 shutdown_connections 2024-09-17T04:24:11.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.406+0000 7fe24c390640 1 -- 172.21.15.63:0/326714839 wait complete. 2024-09-17T04:24:11.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T04:24:05.537623+0000', 'modified': '2024-09-17T04:24:08.565506+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4857}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4857': {'gid': 4857, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6834/1995424855', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 1995424855}, {'type': 'v1', 'addr': '172.21.15.63:6834', 'nonce': 1995424855}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4857, 'qdb_cluster': [4857]} 2024-09-17T04:24:11.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T04:24:11.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 -- 172.21.15.63:0/450406185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406e170 msgr2=0x7f37440b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 --2- 172.21.15.63:0/450406185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406e170 0x7f37440b3540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f374408d9b0 tx=0x7f373402aa70 comp rx=0 tx=0).stop 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 -- 172.21.15.63:0/450406185 shutdown_connections 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 --2- 172.21.15.63:0/450406185 >> v2:172.21.15.112:3300/0 conn(0x7f374406f4b0 0x7f37440d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 --2- 172.21.15.63:0/450406185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406e170 0x7f37440b3540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 -- 172.21.15.63:0/450406185 >> 172.21.15.63:0/450406185 conn(0x7f374408bfc0 msgr2=0x7f374409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 -- 172.21.15.63:0/450406185 shutdown_connections 2024-09-17T04:24:11.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.939+0000 7f374955f640 1 -- 172.21.15.63:0/450406185 wait complete. 2024-09-17T04:24:11.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.941+0000 7f374955f640 1 Processor -- start 2024-09-17T04:24:11.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.941+0000 7f374955f640 1 -- start start 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37440d3870 0x7f37440c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3744151780 0x7f37440ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f37440d0ce0 con 0x7f374406f4b0 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37440cf4e0 con 0x7f3744151780 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f374955f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f37440d0e60 con 0x7f37440d3870 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55786/0 (socket says 172.21.15.63:55786) 2024-09-17T04:24:11.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f3742ffd640 1 -- 172.21.15.63:0/3677977118 learned_addr learned my addr 172.21.15.63:0/3677977118 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f37427fc640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37440d3870 0x7f37440c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.942+0000 7f37437fe640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3744151780 0x7f37440ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 -- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37440d3870 msgr2=0x7f37440c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37440d3870 0x7f37440c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 -- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3744151780 msgr2=0x7f37440ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3744151780 0x7f37440ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 -- 172.21.15.63:0/3677977118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37441f2c50 con 0x7f374406f4b0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f3742ffd640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3734000f80 tx=0x7f3734003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f373b7fe640 1 -- 172.21.15.63:0/3677977118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734046070 con 0x7f374406f4b0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f373b7fe640 1 -- 172.21.15.63:0/3677977118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734004540 con 0x7f374406f4b0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37440ce7a0 con 0x7f374406f4b0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f373b7fe640 1 -- 172.21.15.63:0/3677977118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734033070 con 0x7f374406f4b0 2024-09-17T04:24:11.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.943+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37440c94e0 con 0x7f374406f4b0 2024-09-17T04:24:11.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.945+0000 7f373b7fe640 1 -- 172.21.15.63:0/3677977118 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3734049070 con 0x7f374406f4b0 2024-09-17T04:24:11.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.945+0000 7f373b7fe640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.945+0000 7f373b7fe640 1 -- 172.21.15.63:0/3677977118 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f37340bbed0 con 0x7f374406f4b0 2024-09-17T04:24:11.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.946+0000 7f37427fc640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.946+0000 7f37427fc640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 0x7f372407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f37440cba00 tx=0x7f372c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.946+0000 7f37504c8740 1 Processor -- start 2024-09-17T04:24:11.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.947+0000 7f37504c8740 1 -- start start 2024-09-17T04:24:11.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a4c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a69400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5565e2994820 con 0x5565e267a270 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5565e2983c50 con 0x5565e26513b0 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5565e2987a60 con 0x5565e2659590 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55790/0 (socket says 172.21.15.63:55790) 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 -- 172.21.15.63:0/2037359243 learned_addr learned my addr 172.21.15.63:0/2037359243 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37437fe640 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a69400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f37427fc640 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a4c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 -- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 msgr2=0x5565e2a69400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a69400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 -- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 msgr2=0x5565e2a4c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a4c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.948+0000 7f3742ffd640 1 -- 172.21.15.63:0/2037359243 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e26e5850 con 0x5565e267a270 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f3742ffd640 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37340ba3a0 tx=0x7f3734083b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249f4f839bbdef60 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f3738ff9640 1 -- 172.21.15.63:0/2037359243 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734083cc0 con 0x5565e267a270 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f3738ff9640 1 -- 172.21.15.63:0/2037359243 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734088070 con 0x5565e267a270 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f3738ff9640 1 -- 172.21.15.63:0/2037359243 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734088440 con 0x5565e267a270 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f37504c8740 1 -- 172.21.15.63:0/2037359243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 msgr2=0x5565e2a4bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.949+0000 7f37504c8740 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f37340ba3a0 tx=0x7f3734083b90 comp rx=0 tx=0).stop 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 -- 172.21.15.63:0/2037359243 shutdown_connections 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a4c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a69400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 --2- 172.21.15.63:0/2037359243 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a4bfc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 -- 172.21.15.63:0/2037359243 >> 172.21.15.63:0/2037359243 conn(0x5565e266e3c0 msgr2=0x5565e2a22280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 -- 172.21.15.63:0/2037359243 shutdown_connections 2024-09-17T04:24:11.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.950+0000 7f37504c8740 1 -- 172.21.15.63:0/2037359243 wait complete. 2024-09-17T04:24:11.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.951+0000 7f37504c8740 1 -- start start 2024-09-17T04:24:11.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.951+0000 7f37504c8740 1 Processor -- start 2024-09-17T04:24:11.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e26513b0 0x5565e2a61710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e2659590 0x5565e2a22300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5565e26f4620 con 0x5565e267a270 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5565e29295f0 con 0x5565e2659590 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5565e2983c50 con 0x5565e26513b0 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37504c8740 10 client.0 _ll_register_callbacks cb 0x5565e292d0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37437fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37437fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55796/0 (socket says 172.21.15.63:55796) 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37437fe640 1 -- 172.21.15.63:0/4128291324 learned_addr learned my addr 172.21.15.63:0/4128291324 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f3742ffd640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e26513b0 0x5565e2a61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.952+0000 7f37427fc640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e2659590 0x5565e2a22300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 -- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e26513b0 msgr2=0x5565e2a61710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e26513b0 0x5565e2a61710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 -- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e2659590 msgr2=0x5565e2a22300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e2659590 0x5565e2a22300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 -- 172.21.15.63:0/4128291324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e275c6b0 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37437fe640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f373c001df0 tx=0x7f373c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b049e69ac800ae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c005320 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f373c007030 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3734088070 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f373c007230 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 10 client.5034 fetch_fsmap learned FSMap version 17 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5565e2a61f60 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734088070 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f373c0073d0 con 0x5565e267a270 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 10 client.5034 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T04:24:11.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 10 client.5034 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 20 client.5034 populate_metadata read hostname 'smithi063' 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e2638e40 0x5565e2a79260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 4 client.5034 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.953+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 --> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565e2996770 con 0x5565e2638e40 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.954+0000 7f3742ffd640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e2638e40 0x5565e2a79260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.954+0000 7f3721ffb640 10 client.5034 ms_handle_connect on v2:172.21.15.63:6832/1995424855 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.954+0000 7f3742ffd640 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e2638e40 0x5565e2a79260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3f9f3d22e40420 server_cookie=38365e8e921afda6 in_seq=0 out_seq=0 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f3721ffb640 1 -- 172.21.15.63:0/4128291324 <== mds.0 v2:172.21.15.63:6832/1995424855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565e2996770 con 0x5565e2638e40 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f3721ffb640 10 client.5034 handle_command_reply: tid=0 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 client.5034 shutdown 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 msgr2=0x5565e2a22840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f373c001df0 tx=0x7f373c012690 comp rx=0 tx=0).stop 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 shutdown_connections 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e2638e40 0x5565e2a79260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e2659590 0x5565e2a22300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f3721ffb640 0 client.5034 ms_handle_reset on v2:172.21.15.63:6832/1995424855 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e267a270 0x5565e2a22840 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 --2- 172.21.15.63:0/4128291324 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e26513b0 0x5565e2a61710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 >> 172.21.15.63:0/4128291324 conn(0x5565e266e3c0 msgr2=0x5565e2a1bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 shutdown_connections 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 1 -- 172.21.15.63:0/4128291324 wait complete. 2024-09-17T04:24:11.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.955+0000 7f37504c8740 20 client.5034 trim_cache size 0 max 16384 2024-09-17T04:24:11.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.974+0000 7f37504c8740 1 Processor -- start 2024-09-17T04:24:11.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.974+0000 7f37504c8740 1 -- start start 2024-09-17T04:24:11.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a1c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a1cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f37442012c0 con 0x5565e2638e40 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f37441f5d30 con 0x5565e26513b0 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3744200ca0 con 0x5565e2659590 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55812/0 (socket says 172.21.15.63:55812) 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 -- 172.21.15.63:0/1496244314 learned_addr learned my addr 172.21.15.63:0/1496244314 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 -- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 msgr2=0x5565e2a1cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37427fc640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a1c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37437fe640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a1cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a1cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 -- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 msgr2=0x5565e2a1c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a1c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 -- 172.21.15.63:0/1496244314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e2a628c0 con 0x5565e2638e40 2024-09-17T04:24:11.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37427fc640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a1c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f37437fe640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a1cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.975+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f373402b060 tx=0x7f373402aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd4ac45e9a36686 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f3723fff640 1 -- 172.21.15.63:0/1496244314 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734083cc0 con 0x5565e2638e40 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f3723fff640 1 -- 172.21.15.63:0/1496244314 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734088040 con 0x5565e2638e40 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f3723fff640 1 -- 172.21.15.63:0/1496244314 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37340881f0 con 0x5565e2638e40 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 -- 172.21.15.63:0/1496244314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 msgr2=0x5565e2a4c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f373402b060 tx=0x7f373402aa70 comp rx=0 tx=0).stop 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 -- 172.21.15.63:0/1496244314 shutdown_connections 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2a1c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2659590 0x5565e2a1cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 --2- 172.21.15.63:0/1496244314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2638e40 0x5565e2a4c230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 -- 172.21.15.63:0/1496244314 >> 172.21.15.63:0/1496244314 conn(0x5565e266e3c0 msgr2=0x5565e2a22660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.976+0000 7f37504c8740 1 -- 172.21.15.63:0/1496244314 shutdown_connections 2024-09-17T04:24:11.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.977+0000 7f37504c8740 1 -- 172.21.15.63:0/1496244314 wait complete. 2024-09-17T04:24:11.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.977+0000 7f37504c8740 1 -- start start 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.977+0000 7f37504c8740 1 Processor -- start 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 0x5565e2ae8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2ae52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5565e2a5c940 con 0x5565e2659590 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x5565e2994820 con 0x5565e26513b0 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x5565e2a77fa0 con 0x5565e2638e40 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37504c8740 10 client.0 _ll_register_callbacks cb 0x7f373c001a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55826/0 (socket says 172.21.15.63:55826) 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 -- 172.21.15.63:0/1493876597 learned_addr learned my addr 172.21.15.63:0/1493876597 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 0x5565e2ae8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37427fc640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2ae52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 -- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 msgr2=0x5565e2ae8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 0x5565e2ae8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 -- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 msgr2=0x5565e2ae52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2ae52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 -- 172.21.15.63:0/1493876597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e2a693b0 con 0x5565e2659590 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 0x5565e2ae8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f37437fe640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5565e2a1eca0 tx=0x7f373c005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de642a3e8a95e7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.979+0000 7f3721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-17T04:24:11.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c000f40 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f373c006bf0 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3734088040 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f373c036050 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 10 client.5040 fetch_fsmap learned FSMap version 17 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5565e2a69a00 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3734088040 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f373c039020 con 0x5565e2659590 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 10 client.5040 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 10 client.5040 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 20 client.5040 populate_metadata read hostname 'smithi063' 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e260e280 0x5565e2a67780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 4 client.5040 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 --> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] -- command(tid 0: {"prefix": "status"}) -- 0x5565e2992220 con 0x5565e260e280 2024-09-17T04:24:11.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.980+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e260e280 0x5565e2a67780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f3721ffb640 10 client.5040 ms_handle_connect on v2:172.21.15.63:6832/1995424855 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f3742ffd640 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e260e280 0x5565e2a67780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3e48aa1f304c523 server_cookie=ac8232f87dbc70 in_seq=0 out_seq=0 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f3721ffb640 1 -- 172.21.15.63:0/1493876597 <== mds.0 v2:172.21.15.63:6832/1995424855 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5565e2992220 con 0x5565e260e280 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f3721ffb640 10 client.5040 handle_command_reply: tid=0 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 client.5040 shutdown 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 msgr2=0x5565e2a74360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5565e2a1eca0 tx=0x7f373c005550 comp rx=0 tx=0).stop 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 shutdown_connections 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:6832/1995424855,v1:172.21.15.63:6834/1995424855] conn(0x5565e260e280 0x5565e2a67780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x5565e26513b0 0x5565e2ae52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5565e2659590 0x5565e2a74360 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 --2- 172.21.15.63:0/1493876597 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x5565e2638e40 0x5565e2ae8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f3721ffb640 0 client.5040 ms_handle_reset on v2:172.21.15.63:6832/1995424855 2024-09-17T04:24:11.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 >> 172.21.15.63:0/1493876597 conn(0x5565e266e3c0 msgr2=0x5565e2a22640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 shutdown_connections 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 1 -- 172.21.15.63:0/1493876597 wait complete. 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.981+0000 7f37504c8740 20 client.5040 trim_cache size 0 max 16384 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "2184e050-2c9d-47fc-8e14-c53eccd8cf79", 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4857, 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-17T04:24:11.987 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 5.8288240309999999, 2024-09-17T04:24:11.988 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 17, 2024-09-17T04:24:11.988 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 32, 2024-09-17T04:24:11.988 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 32, 2024-09-17T04:24:11.988 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 12.736082519 2024-09-17T04:24:11.988 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 msgr2=0x7f372407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 0x7f372407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f37440cba00 tx=0x7f372c00b2e0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 msgr2=0x7f37441f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3734000f80 tx=0x7f3734003f10 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 shutdown_connections 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3724078b90 0x7f372407b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3744151780 0x7f37440ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f37440d3870 0x7f37440c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 --2- 172.21.15.63:0/3677977118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f374406f4b0 0x7f37441f2710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 >> 172.21.15.63:0/3677977118 conn(0x7f374408bfc0 msgr2=0x7f3744068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 shutdown_connections 2024-09-17T04:24:11.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:11.982+0000 7f374955f640 1 -- 172.21.15.63:0/3677977118 wait complete. 2024-09-17T04:24:11.993 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T04:24:12.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 -- 172.21.15.63:0/4060614271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40ccbd0 msgr2=0x7fecc40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:12.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 --2- 172.21.15.63:0/4060614271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40ccbd0 0x7fecc40d0d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fecb8005fd0 tx=0x7fecb802a5d0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 -- 172.21.15.63:0/4060614271 shutdown_connections 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 --2- 172.21.15.63:0/4060614271 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40ccbd0 0x7fecc40d0d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 --2- 172.21.15.63:0/4060614271 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40b51c0 0x7fecc415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 -- 172.21.15.63:0/4060614271 >> 172.21.15.63:0/4060614271 conn(0x7fecc4072ae0 msgr2=0x7fecc4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 -- 172.21.15.63:0/4060614271 shutdown_connections 2024-09-17T04:24:12.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.109+0000 7fecc9d50640 1 -- 172.21.15.63:0/4060614271 wait complete. 2024-09-17T04:24:12.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.111+0000 7fecc9d50640 1 Processor -- start 2024-09-17T04:24:12.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.111+0000 7fecc9d50640 1 -- start start 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40ccbd0 0x7fecc41f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 0x7fecc40aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fecc4160a60 con 0x7fecc40b51c0 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40d1a20 con 0x7fecc40d12c0 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc9d50640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fecc4160be0 con 0x7fecc40ccbd0 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:12.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55846/0 (socket says 172.21.15.63:55846) 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 -- 172.21.15.63:0/2752835674 learned_addr learned my addr 172.21.15.63:0/2752835674 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc2ffd640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40ccbd0 0x7fecc41f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc3fff640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 0x7fecc40aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 -- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40ccbd0 msgr2=0x7fecc41f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40ccbd0 0x7fecc41f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 -- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 msgr2=0x7fecc40aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 0x7fecc40aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 -- 172.21.15.63:0/2752835674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc41f3c70 con 0x7fecc40b51c0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc3fff640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 0x7fecc40aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.113+0000 7fecc37fe640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e790 tx=0x7fecb400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.114+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb400eea0 con 0x7fecc40b51c0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.114+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fecb400cdb0 con 0x7fecc40b51c0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.114+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc4157c60 con 0x7fecc40b51c0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.114+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4010690 con 0x7fecc40b51c0 2024-09-17T04:24:12.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.114+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc4158200 con 0x7fecc40b51c0 2024-09-17T04:24:12.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.115+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4073970 con 0x7fecc40b51c0 2024-09-17T04:24:12.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.116+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fecb4010830 con 0x7fecc40b51c0 2024-09-17T04:24:12.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.116+0000 7fecabfff640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:12.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.116+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fecb409b6a0 con 0x7fecc40b51c0 2024-09-17T04:24:12.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.116+0000 7fecc2ffd640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:12.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.117+0000 7fecc2ffd640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 0x7fecb007b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fecb8033000 tx=0x7fecb8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.121+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fecc4073970 con 0x7fecc40b51c0 2024-09-17T04:24:12.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.342+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fecc4161090 con 0x7fecc40b51c0 2024-09-17T04:24:12.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.342+0000 7fecabfff640 1 -- 172.21.15.63:0/2752835674 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fecb4063520 con 0x7fecc40b51c0 2024-09-17T04:24:12.342 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 msgr2=0x7fecb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 0x7fecb007b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fecb8033000 tx=0x7fecb8004730 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 msgr2=0x7fecc41553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fecb400e790 tx=0x7fecb400ec50 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 shutdown_connections 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fecb0078b90 0x7fecb007b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fecc40d12c0 0x7fecc40aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fecc40ccbd0 0x7fecc41f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 --2- 172.21.15.63:0/2752835674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fecc40b51c0 0x7fecc41553f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.344+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 >> 172.21.15.63:0/2752835674 conn(0x7fecc4072ae0 msgr2=0x7fecc40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:12.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.345+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 shutdown_connections 2024-09-17T04:24:12.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12.345+0000 7fecc9d50640 1 -- 172.21.15.63:0/2752835674 wait complete. 2024-09-17T04:24:12.355 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T04:24:12.356 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:24:12.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.356 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:24:12.373 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 82:0b:65:e1:6b:7e brd ff:ff:ff:ff:ff:ff 2024-09-17T04:24:12.374 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::470:6fff:fe80:2856/64 scope link 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 82:89:e1:21:92:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::8089:e1ff:fe21:92f1/64 scope link 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 82:0b:65:e1:6b:7e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::800b:65ff:fee1:6b7e/64 scope link 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-17T04:24:12.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.376 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T04:24:12.438 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-17T04:24:12.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.440 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-17T04:24:12.498 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-17T04:24:12.498 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T04:24:12.499 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T04:24:12.499 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T04:24:12.499 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T04:24:12.499 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T04:24:12.499 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-17T04:24:12.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T04:24:12.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T04:24:12.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T04:24:12.500 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-17T04:24:12.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T04:24:12.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:24:12.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.628 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:24:12.643 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T04:24:12.644 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:24:12.644 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:24:12.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-17T04:24:12.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:24:12.710 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T04:24:12.766 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T04:24:12.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T04:24:12.766 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:24:12.822 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T04:24:12.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:24:12.916 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:24:12.917 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:24:12.917 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:24:12.928 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:24:12.928 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:24:12.928 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:24:12.928 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:24:12.928 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:24:12.934 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T04:24:12.934 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T04:24:12.934 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.112:3300,172.21.15.112:3301" 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790" 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.112:6789,172.21.15.112:6790:/ 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2184e050-2c9d-47fc-8e14-c53eccd8cf79" will pass to kernel 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T04:24:12.935 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-17T04:24:12.936 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T04:24:12.936 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T04:24:12.936 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T04:24:12.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T04:24:12.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:12.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T04:24:12.963 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T04:24:13.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T04:24:13.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T04:24:13.066 INFO:teuthology.orchestra.run.smithi063.stdout:client4778 2024-09-17T04:24:13.067 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:24:13.067 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:24:13.084 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=xfstests-dev 2024-09-17T04:24:13.139 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.9Nr4XTowM0xfstests-dev 2024-09-17T04:24:13.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:13.140 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.9Nr4XTowM0xfstests-dev) 2024-09-17T04:24:13.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:13.209 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.9Nr4XTowM0xfstests-dev) 2024-09-17T04:24:13.267 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/tmp/tmp.9Nr4XTowM0xfstests-dev'... 2024-09-17T04:24:13.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:13.906 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-09-17T04:24:13.968 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=test 2024-09-17T04:24:14.023 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.fBrKwjZjWstest 2024-09-17T04:24:14.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:24:14.023 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-09-17T04:24:14.081 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=scratch 2024-09-17T04:24:14.137 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.Veb0Rzel4mscratch 2024-09-17T04:24:14.138 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9.stream". 2024-09-17T04:24:14.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-09-17T04:24:14.795 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:03:16 ago on Tue 17 Sep 2024 04:20:58 AM UTC. 2024-09-17T04:24:14.891 INFO:teuthology.orchestra.run.smithi063.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:24:14.892 INFO:teuthology.orchestra.run.smithi063.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T04:24:14.893 INFO:teuthology.orchestra.run.smithi063.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-09-17T04:24:14.894 INFO:teuthology.orchestra.run.smithi063.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-09-17T04:24:14.894 INFO:teuthology.orchestra.run.smithi063.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-09-17T04:24:14.896 INFO:teuthology.orchestra.run.smithi063.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-09-17T04:24:14.898 INFO:teuthology.orchestra.run.smithi063.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-09-17T04:24:14.899 INFO:teuthology.orchestra.run.smithi063.stdout:Package gcc-11.5.0-2.el9.x86_64 is already installed. 2024-09-17T04:24:14.901 INFO:teuthology.orchestra.run.smithi063.stdout:Package git-2.43.5-1.el9.x86_64 is already installed. 2024-09-17T04:24:14.903 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T04:24:14.904 INFO:teuthology.orchestra.run.smithi063.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-09-17T04:24:14.906 INFO:teuthology.orchestra.run.smithi063.stdout:Package libtool-2.4.6-46.el9.x86_64 is already installed. 2024-09-17T04:24:14.907 INFO:teuthology.orchestra.run.smithi063.stdout:Package libuuid-devel-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T04:24:14.908 INFO:teuthology.orchestra.run.smithi063.stdout:Package lvm2-9:2.03.24-2.el9.x86_64 is already installed. 2024-09-17T04:24:14.909 INFO:teuthology.orchestra.run.smithi063.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-09-17T04:24:14.909 INFO:teuthology.orchestra.run.smithi063.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-09-17T04:24:14.910 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-3.9.19-8.el9.x86_64 is already installed. 2024-09-17T04:24:14.911 INFO:teuthology.orchestra.run.smithi063.stdout:Package quota-1:4.09-2.el9.x86_64 is already installed. 2024-09-17T04:24:14.912 INFO:teuthology.orchestra.run.smithi063.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-09-17T04:24:14.915 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T04:24:14.964 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-17T04:24:14.965 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-devel x86_64 5.14.0-508.el9 appstream 20 M 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-09-17T04:24:14.966 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout:Install 16 Packages 2024-09-17T04:24:14.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:14.968 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 28 M 2024-09-17T04:24:14.968 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 80 M 2024-09-17T04:24:14.968 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-17T04:24:15.624 INFO:teuthology.orchestra.run.smithi063.stdout:(1/16): fio-engine-http-3.35-1.el9.x86_64.rpm 159 kB/s | 18 kB 00:00 2024-09-17T04:24:15.649 INFO:teuthology.orchestra.run.smithi063.stdout:(2/16): rmt-1.6-6.el9.x86_64.rpm 332 kB/s | 46 kB 00:00 2024-09-17T04:24:15.674 INFO:teuthology.orchestra.run.smithi063.stdout:(3/16): fio-engine-libaio-3.35-1.el9.x86_64.rpm 312 kB/s | 16 kB 00:00 2024-09-17T04:24:15.724 INFO:teuthology.orchestra.run.smithi063.stdout:(4/16): fio-engine-rados-3.35-1.el9.x86_64.rpm 316 kB/s | 16 kB 00:00 2024-09-17T04:24:15.866 INFO:teuthology.orchestra.run.smithi063.stdout:(5/16): fio-engine-nbd-3.35-1.el9.x86_64.rpm 67 kB/s | 15 kB 00:00 2024-09-17T04:24:15.892 INFO:teuthology.orchestra.run.smithi063.stdout:(6/16): fio-engine-rbd-3.35-1.el9.x86_64.rpm 97 kB/s | 16 kB 00:00 2024-09-17T04:24:15.917 INFO:teuthology.orchestra.run.smithi063.stdout:(7/16): fio-engine-rdma-3.35-1.el9.x86_64.rpm 412 kB/s | 21 kB 00:00 2024-09-17T04:24:15.917 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] kernel-devel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/kernel-devel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:24:15.984 INFO:teuthology.orchestra.run.smithi063.stdout:(8/16): libcap-devel-2.48-9.el9.x86_64.rpm 611 kB/s | 41 kB 00:00 2024-09-17T04:24:16.007 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] kernel-devel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/kernel-devel-5.14.0-508.el9.x86_64.rpm (IP: 206.82.17.213) 2024-09-17T04:24:16.117 INFO:teuthology.orchestra.run.smithi063.stdout:(9/16): sqlite-3.34.1-7.el9.x86_64.rpm 5.5 MB/s | 748 kB 00:00 2024-09-17T04:24:16.168 INFO:teuthology.orchestra.run.smithi063.stdout:(10/16): udftools-2.2-5.el9.x86_64.rpm 2.9 MB/s | 149 kB 00:00 2024-09-17T04:24:16.418 INFO:teuthology.orchestra.run.smithi063.stdout:(11/16): gdbm-1.23-1.el9.x86_64.rpm 613 kB/s | 153 kB 00:00 2024-09-17T04:24:16.502 INFO:teuthology.orchestra.run.smithi063.stdout:(12/16): fio-3.35-1.el9.x86_64.rpm 6.3 MB/s | 6.2 MB 00:00 2024-09-17T04:24:16.527 INFO:teuthology.orchestra.run.smithi063.stdout:(13/16): gdbm-devel-1.23-1.el9.x86_64.rpm 744 kB/s | 81 kB 00:00 2024-09-17T04:24:16.586 INFO:teuthology.orchestra.run.smithi063.stdout:(14/16): dump-0.4-0.51.b47.el9.x86_64.rpm 1.0 MB/s | 88 kB 00:00 2024-09-17T04:24:16.619 INFO:teuthology.orchestra.run.smithi063.stdout:(15/16): indent-2.2.13-5.el9.x86_64.rpm 1.9 MB/s | 179 kB 00:00 2024-09-17T04:24:16.903 INFO:teuthology.orchestra.run.smithi063.stdout:(16/16): kernel-devel-5.14.0-508.el9.x86_64.rpm 20 MB/s | 20 MB 00:01 2024-09-17T04:24:16.906 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-17T04:24:16.906 INFO:teuthology.orchestra.run.smithi063.stdout:Total 14 MB/s | 28 MB 00:01 2024-09-17T04:24:17.249 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-17T04:24:17.317 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-17T04:24:17.317 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-17T04:24:17.956 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-17T04:24:17.957 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-17T04:24:19.058 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-17T04:24:19.113 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/16 2024-09-17T04:24:19.139 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/16 2024-09-17T04:24:19.164 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/16 2024-09-17T04:24:19.189 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/16 2024-09-17T04:24:19.215 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/16 2024-09-17T04:24:19.374 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/16 2024-09-17T04:24:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-3.35-1.el9.x86_64 7/16 2024-09-17T04:24:19.455 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 8/16 2024-09-17T04:24:19.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rmt-2:1.6-6.el9.x86_64 9/16 2024-09-17T04:24:19.538 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 10/16 2024-09-17T04:24:19.582 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 11/16 2024-09-17T04:24:19.624 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : indent-2.2.13-5.el9.x86_64 12/16 2024-09-17T04:24:19.664 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udftools-2.2-5.el9.x86_64 13/16 2024-09-17T04:24:19.711 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 14/16 2024-09-17T04:24:21.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:24:21.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:24:29.902 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 15/16 2024-09-17T04:24:30.195 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-devel-5.14.0-508.el9.x86_64 16/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-devel-5.14.0-508.el9.x86_64 16/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-3.35-1.el9.x86_64 2/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/16 2024-09-17T04:24:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-devel-5.14.0-508.el9.x86_64 9/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 13/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 14/16 2024-09-17T04:24:43.651 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 15/16 2024-09-17T04:24:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : indent-2.2.13-5.el9.x86_64 16/16 2024-09-17T04:24:44.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-508.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel-2.48-9.el9.x86_64 rmt-2:1.6-6.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite-3.34.1-7.el9.x86_64 udftools-2.2-5.el9.x86_64 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:44.099 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-17T04:24:44.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd -m fsgqa 2024-09-17T04:24:44.550 INFO:teuthology.orchestra.run.smithi063.stderr:useradd: user 'fsgqa' already exists 2024-09-17T04:24:44.552 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-17T04:24:44.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo groupadd fsgqa 2024-09-17T04:24:44.618 INFO:teuthology.orchestra.run.smithi063.stderr:groupadd: group 'fsgqa' already exists 2024-09-17T04:24:44.619 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-17T04:24:44.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd fsgqa2 2024-09-17T04:24:45.502 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd 123456-fsgqa 2024-09-17T04:24:46.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-09-17T04:24:46.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3235805366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 msgr2=0x7f9ef4074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3235805366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef4074640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009830 tx=0x7f9edc02a540 comp rx=0 tx=0).stop 2024-09-17T04:24:46.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3235805366 shutdown_connections 2024-09-17T04:24:46.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3235805366 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef4074640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3235805366 >> 172.21.15.63:0/3235805366 conn(0x7f9ef40b1cb0 msgr2=0x7f9ef40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:46.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3235805366 shutdown_connections 2024-09-17T04:24:46.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.490+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3235805366 wait complete. 2024-09-17T04:24:46.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.492+0000 7f9ef8b69640 1 Processor -- start 2024-09-17T04:24:46.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.492+0000 7f9ef8b69640 1 -- start start 2024-09-17T04:24:46.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef40cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 0x7f9ef414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40b3c40 con 0x7f9ef4073170 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef40b3ac0 con 0x7f9ef4070030 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef8b69640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef40b3dc0 con 0x7f9ef4070440 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42224/0 (socket says 172.21.15.63:42224) 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 -- 172.21.15.63:0/3442879032 learned_addr learned my addr 172.21.15.63:0/3442879032 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9eebfff640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 0x7f9ef414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef259c640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef40cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 -- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 msgr2=0x7f9ef414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 0x7f9ef414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 -- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 msgr2=0x7f9ef40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef40cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 -- 172.21.15.63:0/3442879032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef40ce690 con 0x7f9ef4073170 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9eebfff640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 0x7f9ef414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef259c640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef40cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9ef2d9d640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c700 tx=0x7f9eec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.494+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec003b70 con 0x7f9ef4073170 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.495+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eec003d10 con 0x7f9ef4073170 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.495+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00aab0 con 0x7f9ef4073170 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.495+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef40ce970 con 0x7f9ef4073170 2024-09-17T04:24:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.495+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef40cf990 con 0x7f9ef4073170 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.496+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef40cc580 con 0x7f9ef4073170 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.496+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9eec00ac50 con 0x7f9ef4073170 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.497+0000 7f9eeaffd640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 0x7f9ed407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.497+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9eec09aba0 con 0x7f9ef4073170 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.497+0000 7f9ef259c640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 0x7f9ed407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.498+0000 7f9ef259c640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 0x7f9ed407b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4001220 tx=0x7f9ee4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:46.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.502+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9eec062fe0 con 0x7f9ef4073170 2024-09-17T04:24:46.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.765+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9ef4076820 con 0x7f9ef4073170 2024-09-17T04:24:46.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.766+0000 7f9eeaffd640 1 -- 172.21.15.63:0/3442879032 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f9eec0628e0 con 0x7f9ef4073170 2024-09-17T04:24:46.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:24:46.766 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","modified":"2024-09-17T04:22:22.888160Z","created":"2024-09-17T04:22:22.888160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3300","nonce":0},{"type":"v1","addr":"172.21.15.112:6789","nonce":0}]},"addr":"172.21.15.112:6789/0","public_addr":"172.21.15.112:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:3301","nonce":0},{"type":"v1","addr":"172.21.15.112:6790","nonce":0}]},"addr":"172.21.15.112:6790/0","public_addr":"172.21.15.112:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-17T04:24:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:dumped monmap epoch 1 2024-09-17T04:24:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 msgr2=0x7f9ed407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 0x7f9ed407b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4001220 tx=0x7f9ee4009040 comp rx=0 tx=0).stop 2024-09-17T04:24:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 msgr2=0x7f9ef41e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c700 tx=0x7f9eec00cbc0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 shutdown_connections 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9ed4078b90 0x7f9ed407b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9ef4073170 0x7f9ef41e94c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f9ef4070440 0x7f9ef414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 --2- 172.21.15.63:0/3442879032 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9ef4070030 0x7f9ef40cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 >> 172.21.15.63:0/3442879032 conn(0x7f9ef40b1cb0 msgr2=0x7f9ef40ada80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 shutdown_connections 2024-09-17T04:24:46.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.768+0000 7f9ef8b69640 1 -- 172.21.15.63:0/3442879032 wait complete. 2024-09-17T04:24:46.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-09-17T04:24:46.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3351740339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 msgr2=0x7f6b440b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3351740339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b440b30c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b44075570 tx=0x7f6b3c02aac0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3351740339 shutdown_connections 2024-09-17T04:24:46.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3351740339 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b440b30c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3351740339 >> v2:172.21.15.112:3300/0 conn(0x7f6b4415b8f0 0x7f6b440cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3351740339 >> 172.21.15.63:0/3351740339 conn(0x7f6b440cdcb0 msgr2=0x7f6b440ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:46.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3351740339 shutdown_connections 2024-09-17T04:24:46.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.900+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3351740339 wait complete. 2024-09-17T04:24:46.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.902+0000 7f6b4ab98640 1 Processor -- start 2024-09-17T04:24:46.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.902+0000 7f6b4ab98640 1 -- start start 2024-09-17T04:24:46.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b440b0520 0x7f6b44149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b4415b8f0 0x7f6b4409da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440ae120 con 0x7f6b440b2cb0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440adfa0 con 0x7f6b440b0520 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b4ab98640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f6b440ae2a0 con 0x7f6b4415b8f0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42240/0 (socket says 172.21.15.63:42240) 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.903+0000 7f6b43fff640 1 -- 172.21.15.63:0/3119276591 learned_addr learned my addr 172.21.15.63:0/3119276591 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b48934640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b440b0520 0x7f6b44149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b49135640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b4415b8f0 0x7f6b4409da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 -- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b4415b8f0 msgr2=0x7f6b4409da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b4415b8f0 0x7f6b4409da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 -- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b440b0520 msgr2=0x7f6b44149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b440b0520 0x7f6b44149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 -- 172.21.15.63:0/3119276591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4414a760 con 0x7f6b440b2cb0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b43fff640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c3c0 tx=0x7f6b3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:46.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38017070 con 0x7f6b440b2cb0 2024-09-17T04:24:46.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b380053c0 con 0x7f6b440b2cb0 2024-09-17T04:24:46.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4414aa40 con 0x7f6b440b2cb0 2024-09-17T04:24:46.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38003850 con 0x7f6b440b2cb0 2024-09-17T04:24:46.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.904+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b44147e40 con 0x7f6b440b2cb0 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.905+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b440ae7c0 con 0x7f6b440b2cb0 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.906+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b3801a070 con 0x7f6b440b2cb0 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.906+0000 7f6b417fa640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 0x7f6b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.907+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6b38099f30 con 0x7f6b440b2cb0 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.907+0000 7f6b48934640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 0x7f6b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:24:46.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.907+0000 7f6b48934640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 0x7f6b3007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b34004590 tx=0x7f6b3400b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:24:46.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:46.911+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b440b3600 con 0x7f6b440b2cb0 2024-09-17T04:24:47.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.172+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f6b4414a4f0 con 0x7f6b440b2cb0 2024-09-17T04:24:47.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.173+0000 7f6b417fa640 1 -- 172.21.15.63:0/3119276591 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v19) ==== 92+0+63 (secure 0 0 0) 0x7f6b38061e40 con 0x7f6b440b2cb0 2024-09-17T04:24:47.173 INFO:teuthology.orchestra.run.smithi063.stdout:[client.admin] 2024-09-17T04:24:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQD/A+lmT5vzBhAAsvSi2Wv5T0EX/m1Jqjk7Jg== 2024-09-17T04:24:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 msgr2=0x7f6b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 0x7f6b3007b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b34004590 tx=0x7f6b3400b390 comp rx=0 tx=0).stop 2024-09-17T04:24:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 msgr2=0x7f6b44146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:24:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800c3c0 tx=0x7f6b3800c880 comp rx=0 tx=0).stop 2024-09-17T04:24:47.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 shutdown_connections 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f6b30078b90 0x7f6b3007b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f6b4415b8f0 0x7f6b4409da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b440b2cb0 0x7f6b44146f50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 --2- 172.21.15.63:0/3119276591 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f6b440b0520 0x7f6b44149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 >> 172.21.15.63:0/3119276591 conn(0x7f6b440cdcb0 msgr2=0x7f6b440b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 shutdown_connections 2024-09-17T04:24:47.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:24:47.175+0000 7f6b4ab98640 1 -- 172.21.15.63:0/3119276591 wait complete. 2024-09-17T04:24:47.186 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:24:47.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.9Nr4XTowM0xfstests-dev/local.config 2024-09-17T04:24:47.211 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.63:6789:/test export TEST_DIR=/tmp/tmp.fBrKwjZjWstest export SCRATCH_DEV=172.21.15.63:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Veb0Rzel4mscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQD/A+lmT5vzBhAAsvSi2Wv5T0EX/m1Jqjk7Jg==" 2024-09-17T04:24:47.212 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:24:47.212 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.9Nr4XTowM0xfstests-dev/ceph.exclude 2024-09-17T04:24:47.277 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.9Nr4XTowM0xfstests-dev && exec sudo make) 2024-09-17T04:24:47.379 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize -cfi 2024-09-17T04:24:47.794 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-17T04:24:47.795 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.guess' 2024-09-17T04:24:47.798 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.sub' 2024-09-17T04:24:47.802 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './install-sh' 2024-09-17T04:24:47.806 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './ltmain.sh' 2024-09-17T04:24:47.829 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-17T04:24:47.829 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-17T04:24:47.833 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-17T04:24:47.838 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-17T04:24:47.842 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-17T04:24:47.847 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-17T04:24:47.853 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-17T04:24:47.854 INFO:teuthology.orchestra.run.smithi063.stdout:cp include/install-sh . 2024-09-17T04:24:47.855 INFO:teuthology.orchestra.run.smithi063.stdout:aclocal -I m4 2024-09-17T04:24:48.909 INFO:teuthology.orchestra.run.smithi063.stdout:autoheader 2024-09-17T04:24:49.220 INFO:teuthology.orchestra.run.smithi063.stdout:autoconf 2024-09-17T04:24:49.398 INFO:teuthology.orchestra.run.smithi063.stdout:./configure \ 2024-09-17T04:24:49.398 INFO:teuthology.orchestra.run.smithi063.stdout: --libexecdir=/usr/lib \ 2024-09-17T04:24:49.398 INFO:teuthology.orchestra.run.smithi063.stdout: --exec_prefix=/var/lib 2024-09-17T04:24:49.756 INFO:teuthology.orchestra.run.smithi063.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-17T04:24:49.756 INFO:teuthology.orchestra.run.smithi063.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-17T04:24:49.757 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to print strings... printf 2024-09-17T04:24:49.757 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... gcc 2024-09-17T04:24:49.861 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the C compiler works... yes 2024-09-17T04:24:49.861 INFO:teuthology.orchestra.run.smithi063.stdout:checking for C compiler default output file name... a.out 2024-09-17T04:24:49.889 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of executables... 2024-09-17T04:24:49.958 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are cross compiling... no 2024-09-17T04:24:49.976 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of object files... o 2024-09-17T04:24:49.992 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... yes 2024-09-17T04:24:50.008 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... yes 2024-09-17T04:24:50.056 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-17T04:24:50.059 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a sed that does not truncate output... /bin/sed 2024-09-17T04:24:50.061 INFO:teuthology.orchestra.run.smithi063.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-09-17T04:24:50.062 INFO:teuthology.orchestra.run.smithi063.stdout:checking for egrep... /bin/grep -E 2024-09-17T04:24:50.063 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fgrep... /bin/grep -F 2024-09-17T04:24:50.067 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ld used by gcc... /bin/ld 2024-09-17T04:24:50.068 INFO:teuthology.orchestra.run.smithi063.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-09-17T04:24:50.081 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-09-17T04:24:50.968 INFO:teuthology.orchestra.run.smithi063.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-09-17T04:24:50.969 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2024-09-17T04:24:50.975 INFO:teuthology.orchestra.run.smithi063.stdout:checking the maximum length of command line arguments... 1572864 2024-09-17T04:24:50.979 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-17T04:24:50.979 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-17T04:24:50.979 INFO:teuthology.orchestra.run.smithi063.stdout:checking for /bin/ld option to reload object files... -r 2024-09-17T04:24:50.980 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdump... objdump 2024-09-17T04:24:50.980 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to recognize dependent libraries... pass_all 2024-09-17T04:24:50.980 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlltool... no 2024-09-17T04:24:50.980 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-17T04:24:50.980 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ar... ar 2024-09-17T04:24:51.031 INFO:teuthology.orchestra.run.smithi063.stdout:checking for archiver @FILE support... @ 2024-09-17T04:24:51.032 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strip... strip 2024-09-17T04:24:51.032 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ranlib... ranlib 2024-09-17T04:24:51.032 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gawk... gawk 2024-09-17T04:24:51.099 INFO:teuthology.orchestra.run.smithi063.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-09-17T04:24:51.101 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sysroot... no 2024-09-17T04:24:51.104 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a working dd... /bin/dd 2024-09-17T04:24:51.106 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-09-17T04:24:51.120 INFO:teuthology.orchestra.run.smithi063.stdout:checking for mt... no 2024-09-17T04:24:51.122 INFO:teuthology.orchestra.run.smithi063.stdout:checking if : is a manifest tool... no 2024-09-17T04:24:51.189 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to run the C preprocessor... gcc -E 2024-09-17T04:24:51.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:24:51.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:24:51.403 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ANSI C header files... yes 2024-09-17T04:24:51.425 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... yes 2024-09-17T04:24:51.462 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... yes 2024-09-17T04:24:51.486 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdlib.h... yes 2024-09-17T04:24:51.512 INFO:teuthology.orchestra.run.smithi063.stdout:checking for string.h... yes 2024-09-17T04:24:51.539 INFO:teuthology.orchestra.run.smithi063.stdout:checking for memory.h... yes 2024-09-17T04:24:51.565 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... yes 2024-09-17T04:24:51.593 INFO:teuthology.orchestra.run.smithi063.stdout:checking for inttypes.h... yes 2024-09-17T04:24:51.619 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdint.h... yes 2024-09-17T04:24:51.658 INFO:teuthology.orchestra.run.smithi063.stdout:checking for unistd.h... yes 2024-09-17T04:24:51.691 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlfcn.h... yes 2024-09-17T04:24:51.694 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdir... .libs 2024-09-17T04:24:51.760 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-17T04:24:51.760 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-17T04:24:51.776 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-17T04:24:51.808 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc static flag -static works... no 2024-09-17T04:24:51.830 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... yes 2024-09-17T04:24:51.832 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-17T04:24:51.836 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-17T04:24:51.868 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether -lc should be explicitly linked in... no 2024-09-17T04:24:51.917 INFO:teuthology.orchestra.run.smithi063.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-17T04:24:51.917 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to hardcode library paths into programs... immediate 2024-09-17T04:24:51.918 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether stripping libraries is possible... yes 2024-09-17T04:24:51.919 INFO:teuthology.orchestra.run.smithi063.stdout:checking if libtool supports shared libraries... yes 2024-09-17T04:24:51.919 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build shared libraries... yes 2024-09-17T04:24:51.919 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build static libraries... yes 2024-09-17T04:24:51.924 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... (cached) gcc 2024-09-17T04:24:51.940 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-17T04:24:51.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-17T04:24:51.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-17T04:24:51.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gmake... /usr/bin/gmake 2024-09-17T04:24:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-17T04:24:51.942 INFO:teuthology.orchestra.run.smithi063.stdout:checking for tar... /bin/tar 2024-09-17T04:24:51.942 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gzip... /bin/gzip 2024-09-17T04:24:51.956 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc -MM is supported... yes 2024-09-17T04:24:51.956 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sort... /bin/sort 2024-09-17T04:24:51.956 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2024-09-17T04:24:51.956 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpm... /bin/rpm 2024-09-17T04:24:51.959 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpmbuild... no 2024-09-17T04:24:51.985 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h usability... yes 2024-09-17T04:24:51.994 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h presence... yes 2024-09-17T04:24:51.994 INFO:teuthology.orchestra.run.smithi063.stdout:checking for assert.h... yes 2024-09-17T04:24:52.021 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h usability... no 2024-09-17T04:24:52.032 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h presence... no 2024-09-17T04:24:52.033 INFO:teuthology.orchestra.run.smithi063.stdout:checking for bstring.h... no 2024-09-17T04:24:52.058 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h usability... yes 2024-09-17T04:24:52.067 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h presence... yes 2024-09-17T04:24:52.067 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libgen.h... yes 2024-09-17T04:24:52.096 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h usability... yes 2024-09-17T04:24:52.106 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h presence... yes 2024-09-17T04:24:52.106 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dirent.h... yes 2024-09-17T04:24:52.164 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h usability... yes 2024-09-17T04:24:52.172 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h presence... yes 2024-09-17T04:24:52.172 INFO:teuthology.orchestra.run.smithi063.stdout:checking for errno.h... yes 2024-09-17T04:24:52.201 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h usability... yes 2024-09-17T04:24:52.212 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h presence... yes 2024-09-17T04:24:52.212 INFO:teuthology.orchestra.run.smithi063.stdout:checking for malloc.h... yes 2024-09-17T04:24:52.240 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h usability... no 2024-09-17T04:24:52.251 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h presence... no 2024-09-17T04:24:52.251 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid.h... no 2024-09-17T04:24:52.289 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h usability... yes 2024-09-17T04:24:52.299 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h presence... yes 2024-09-17T04:24:52.299 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid/uuid.h... yes 2024-09-17T04:24:52.327 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h usability... no 2024-09-17T04:24:52.338 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h presence... no 2024-09-17T04:24:52.338 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/uuid.h... no 2024-09-17T04:24:52.384 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h usability... yes 2024-09-17T04:24:52.394 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h presence... yes 2024-09-17T04:24:52.395 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/file.h... yes 2024-09-17T04:24:52.422 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h usability... yes 2024-09-17T04:24:52.432 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h presence... yes 2024-09-17T04:24:52.432 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fcntl.h... yes 2024-09-17T04:24:52.460 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h usability... no 2024-09-17T04:24:52.471 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h presence... no 2024-09-17T04:24:52.471 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/syssgi.h... no 2024-09-17T04:24:52.532 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h usability... yes 2024-09-17T04:24:52.544 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h presence... yes 2024-09-17T04:24:52.544 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/param.h... yes 2024-09-17T04:24:52.549 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... (cached) yes 2024-09-17T04:24:52.579 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h usability... yes 2024-09-17T04:24:52.588 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h presence... yes 2024-09-17T04:24:52.588 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/statvfs.h... yes 2024-09-17T04:24:52.616 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h usability... yes 2024-09-17T04:24:52.625 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h presence... yes 2024-09-17T04:24:52.625 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/time.h... yes 2024-09-17T04:24:52.659 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h usability... yes 2024-09-17T04:24:52.668 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h presence... yes 2024-09-17T04:24:52.668 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/ioctl.h... yes 2024-09-17T04:24:52.706 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h usability... yes 2024-09-17T04:24:52.717 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h presence... yes 2024-09-17T04:24:52.717 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/wait.h... yes 2024-09-17T04:24:52.722 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... (cached) yes 2024-09-17T04:24:52.727 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... (cached) yes 2024-09-17T04:24:52.755 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h usability... yes 2024-09-17T04:24:52.764 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h presence... yes 2024-09-17T04:24:52.764 INFO:teuthology.orchestra.run.smithi063.stdout:checking for err.h... yes 2024-09-17T04:24:52.793 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h usability... yes 2024-09-17T04:24:52.801 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h presence... yes 2024-09-17T04:24:52.801 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/falloc.h... yes 2024-09-17T04:24:52.830 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-17T04:24:52.842 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-17T04:24:52.842 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-17T04:24:52.867 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-17T04:24:52.878 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-17T04:24:52.879 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-17T04:24:52.904 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h usability... no 2024-09-17T04:24:52.915 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h presence... no 2024-09-17T04:24:52.916 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/platform_defs.h... no 2024-09-17T04:24:52.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h usability... no 2024-09-17T04:24:52.952 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h presence... no 2024-09-17T04:24:52.952 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfs/ioctl.h... no 2024-09-17T04:24:52.977 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h usability... no 2024-09-17T04:24:52.988 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h presence... no 2024-09-17T04:24:52.988 INFO:teuthology.orchestra.run.smithi063.stdout:checking for cifs/ioctl.h... no 2024-09-17T04:24:53.024 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h usability... yes 2024-09-17T04:24:53.033 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h presence... yes 2024-09-17T04:24:53.033 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/mman.h... yes 2024-09-17T04:24:53.062 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/ext4.h usability... no 2024-09-17T04:24:53.073 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/ext4.h presence... no 2024-09-17T04:24:53.073 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/ext4.h... no 2024-09-17T04:24:53.085 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs_log_format.h... no 2024-09-17T04:24:53.139 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare... no 2024-09-17T04:24:53.171 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare in -luuid... yes 2024-09-17T04:24:53.237 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs.h... yes 2024-09-17T04:24:53.250 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/libxfs.h... no 2024-09-17T04:24:53.266 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-17T04:24:53.298 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xqm.h... yes 2024-09-17T04:24:53.348 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-17T04:24:53.373 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h usability... yes 2024-09-17T04:24:53.381 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h presence... yes 2024-09-17T04:24:53.381 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/handle.h... yes 2024-09-17T04:24:53.425 INFO:teuthology.orchestra.run.smithi063.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-17T04:24:53.459 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h usability... yes 2024-09-17T04:24:53.468 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h presence... yes 2024-09-17T04:24:53.469 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/acl.h... yes 2024-09-17T04:24:53.507 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h usability... yes 2024-09-17T04:24:53.517 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h presence... yes 2024-09-17T04:24:53.517 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl/libacl.h... yes 2024-09-17T04:24:53.550 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl_init in -lacl... yes 2024-09-17T04:24:53.574 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h usability... no 2024-09-17T04:24:53.585 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h presence... no 2024-09-17T04:24:53.586 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm-ndbm.h... no 2024-09-17T04:24:53.609 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h usability... yes 2024-09-17T04:24:53.621 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h presence... yes 2024-09-17T04:24:53.621 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm/ndbm.h... yes 2024-09-17T04:24:53.657 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm... no 2024-09-17T04:24:53.694 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm... no 2024-09-17T04:24:53.729 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm... no 2024-09-17T04:24:53.765 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm... no 2024-09-17T04:24:53.805 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-09-17T04:24:53.838 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-09-17T04:24:53.871 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-09-17T04:24:53.905 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-09-17T04:24:53.929 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h usability... yes 2024-09-17T04:24:53.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h presence... yes 2024-09-17T04:24:53.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libaio.h... yes 2024-09-17T04:24:53.964 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h usability... no 2024-09-17T04:24:53.976 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h presence... no 2024-09-17T04:24:53.976 INFO:teuthology.orchestra.run.smithi063.stdout:checking for liburing.h... no 2024-09-17T04:24:54.001 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h usability... yes 2024-09-17T04:24:54.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h presence... yes 2024-09-17T04:24:54.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/capability.h... yes 2024-09-17T04:24:54.037 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h usability... yes 2024-09-17T04:24:54.045 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h presence... yes 2024-09-17T04:24:54.046 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fiemap.h... yes 2024-09-17T04:24:54.080 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fallocate... yes 2024-09-17T04:24:54.116 INFO:teuthology.orchestra.run.smithi063.stdout:checking for open_by_handle_at... yes 2024-09-17T04:24:54.142 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h usability... yes 2024-09-17T04:24:54.150 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h presence... yes 2024-09-17T04:24:54.151 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fs.h... yes 2024-09-17T04:24:54.174 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h usability... no 2024-09-17T04:24:54.186 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h presence... no 2024-09-17T04:24:54.186 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfsutil.h... no 2024-09-17T04:24:54.224 INFO:teuthology.orchestra.run.smithi063.stdout:checking for copy_file_range... yes 2024-09-17T04:24:54.262 INFO:teuthology.orchestra.run.smithi063.stdout:checking for SEEK_DATA... yes 2024-09-17T04:24:54.313 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BMV_OF_SHARED... yes 2024-09-17T04:24:54.352 INFO:teuthology.orchestra.run.smithi063.stdout:checking for nftw... yes 2024-09-17T04:24:54.393 INFO:teuthology.orchestra.run.smithi063.stdout:checking for RLIMIT_NOFILE... yes 2024-09-17T04:24:54.427 INFO:teuthology.orchestra.run.smithi063.stdout:checking for new enough XFS_IOC_EXCHANGE_RANGE... no 2024-09-17T04:24:54.462 INFO:teuthology.orchestra.run.smithi063.stdout:checking for FICLONE... yes 2024-09-17T04:24:54.497 INFO:teuthology.orchestra.run.smithi063.stdout:checking for renameat2... yes 2024-09-17T04:24:54.532 INFO:teuthology.orchestra.run.smithi063.stdout:checking for reallocarray... yes 2024-09-17T04:24:54.564 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct mount_attr... yes 2024-09-17T04:24:54.603 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-17T04:24:54.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-17T04:24:54.671 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-17T04:24:54.705 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-17T04:24:54.739 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-17T04:24:54.773 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-17T04:24:54.807 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-17T04:24:54.834 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h usability... yes 2024-09-17T04:24:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h presence... yes 2024-09-17T04:24:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs.h... yes 2024-09-17T04:24:54.874 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-17T04:24:54.884 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-17T04:24:54.884 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs_tree.h... yes 2024-09-17T04:24:54.906 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-17T04:24:54.929 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-17T04:24:54.945 INFO:teuthology.orchestra.run.smithi063.stdout:configure: creating ./config.status 2024-09-17T04:24:55.250 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/builddefs 2024-09-17T04:24:55.261 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/config.h 2024-09-17T04:24:55.270 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: executing libtool commands 2024-09-17T04:24:55.310 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2024-09-17T04:24:55.313 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2024-09-17T04:24:55.317 INFO:teuthology.orchestra.run.smithi063.stdout: [LTDEP] 2024-09-17T04:24:55.466 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dataascii.lo 2024-09-17T04:24:55.579 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] databin.lo 2024-09-17T04:24:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] datapid.lo 2024-09-17T04:24:55.825 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] file_lock.lo 2024-09-17T04:24:55.966 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] forker.lo 2024-09-17T04:24:56.091 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pattern.lo 2024-09-17T04:24:56.205 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_flags.lo 2024-09-17T04:24:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random_range.lo 2024-09-17T04:24:56.556 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] string_to_tokens.lo 2024-09-17T04:24:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] str_to_bytes.lo 2024-09-17T04:24:56.788 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] tlibio.lo 2024-09-17T04:24:57.018 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] write_log.lo 2024-09-17T04:24:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random.lo 2024-09-17T04:24:57.344 INFO:teuthology.orchestra.run.smithi063.stdout: [LD] 2024-09-17T04:24:57.427 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2024-09-17T04:24:57.430 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:24:57.583 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] doio 2024-09-17T04:24:58.211 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsstress 2024-09-17T04:24:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsx 2024-09-17T04:25:00.301 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] growfiles 2024-09-17T04:25:00.778 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] iogen 2024-09-17T04:25:01.127 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-stress 2024-09-17T04:25:01.535 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2024-09-17T04:25:01.541 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:25:03.349 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:25:03.380 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:25:03.388 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:25:03.608 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2024-09-17T04:25:03.631 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirstress 2024-09-17T04:25:03.845 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill 2024-09-17T04:25:03.984 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill2 2024-09-17T04:25:04.192 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getpagesize 2024-09-17T04:25:04.312 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holes 2024-09-17T04:25:04.487 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] lstat64 2024-09-17T04:25:04.652 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nametest 2024-09-17T04:25:04.871 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] permname 2024-09-17T04:25:05.050 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] randholes 2024-09-17T04:25:05.276 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] runas 2024-09-17T04:25:05.432 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] truncfile 2024-09-17T04:25:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] usemem 2024-09-17T04:25:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmapcat 2024-09-17T04:25:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_reader 2024-09-17T04:25:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_writer 2024-09-17T04:25:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirperf 2024-09-17T04:25:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] metaperf 2024-09-17T04:25:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] devzero 2024-09-17T04:25:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] feature 2024-09-17T04:25:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] alloc 2024-09-17T04:25:07.118 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fault 2024-09-17T04:25:07.261 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fstest 2024-09-17T04:25:07.476 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_access_root 2024-09-17T04:25:07.613 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] godown 2024-09-17T04:25:07.763 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] resvtest 2024-09-17T04:25:07.928 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writemod 2024-09-17T04:25:08.057 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writev_on_pagefault 2024-09-17T04:25:08.198 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] makeextents 2024-09-17T04:25:08.359 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] itrash 2024-09-17T04:25:08.495 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rename 2024-09-17T04:25:08.617 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] multi_open_unlink 2024-09-17T04:25:08.764 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_sync 2024-09-17T04:25:08.924 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] genhashnames 2024-09-17T04:25:09.096 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_holes 2024-09-17T04:25:09.227 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev 2024-09-17T04:25:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_cmtime 2024-09-17T04:25:09.499 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirhash_collide 2024-09-17T04:25:09.674 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_rename_overwrite 2024-09-17T04:25:09.798 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holetest 2024-09-17T04:25:10.003 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_self 2024-09-17T04:25:10.128 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] af_unix 2024-09-17T04:25:10.265 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_stale_pmd 2024-09-17T04:25:10.400 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_race 2024-09-17T04:25:10.547 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_fallocate 2024-09-17T04:25:10.680 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-err 2024-09-17T04:25:10.845 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_write_ro 2024-09-17T04:25:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-17T04:25:11.121 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-17T04:25:11.259 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ofd_locks 2024-09-17T04:25:11.435 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_collision 2024-09-17T04:25:11.617 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-write-concurrent 2024-09-17T04:25:11.767 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_get_file_time 2024-09-17T04:25:11.897 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_short_dirs 2024-09-17T04:25:12.048 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_long_dirs 2024-09-17T04:25:12.196 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_enospc 2024-09-17T04:25:12.364 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev_overlap 2024-09-17T04:25:12.515 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] checkpoint_journal 2024-09-17T04:25:12.653 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-rw-fault 2024-09-17T04:25:12.818 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] allocstale 2024-09-17T04:25:12.967 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_memory_failure 2024-09-17T04:25:13.119 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fake-dump-rootino 2024-09-17T04:25:13.252 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-buf-fault 2024-09-17T04:25:13.388 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rewinddir-test 2024-09-17T04:25:13.540 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] readdir-while-renames 2024-09-17T04:25:13.686 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-append-buf-fault 2024-09-17T04:25:13.828 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsctl 2024-09-17T04:25:13.997 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bstat 2024-09-17T04:25:14.187 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mtab 2024-09-17T04:25:14.354 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getdevicesize 2024-09-17T04:25:14.481 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_reader 2024-09-17T04:25:14.621 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_writer 2024-09-17T04:25:14.760 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ftrunc 2024-09-17T04:25:14.892 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] trunc 2024-09-17T04:25:15.036 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fs_perms 2024-09-17T04:25:15.184 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] testx 2024-09-17T04:25:15.298 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] looptest 2024-09-17T04:25:15.474 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] locktest 2024-09-17T04:25:15.757 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_mmap 2024-09-17T04:25:15.902 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test 2024-09-17T04:25:16.082 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] deduperace 2024-09-17T04:25:16.258 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test_modified 2024-09-17T04:25:16.434 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset 2024-09-17T04:25:16.565 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_futimens 2024-09-17T04:25:16.689 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_immutable 2024-09-17T04:25:17.276 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stale_handle 2024-09-17T04:25:17.427 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pwrite_mmap_blocked 2024-09-17T04:25:17.565 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset2 2024-09-17T04:25:17.738 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_sanity_test 2024-09-17T04:25:18.157 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_copy_test 2024-09-17T04:25:18.316 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_1 2024-09-17T04:25:18.448 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_2 2024-09-17T04:25:18.584 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-tester 2024-09-17T04:25:18.814 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nsexec 2024-09-17T04:25:18.973 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] cloner 2024-09-17T04:25:19.133 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] renameat2 2024-09-17T04:25:19.281 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_getcwd 2024-09-17T04:25:19.422 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] e4compact 2024-09-17T04:25:19.605 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] test-nextquota 2024-09-17T04:25:19.760 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] punch-alternating 2024-09-17T04:25:19.915 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-17T04:25:20.063 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] listxattr 2024-09-17T04:25:20.194 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-interleaved 2024-09-17T04:25:20.337 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_type 2024-09-17T04:25:20.475 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-invalidate-cache 2024-09-17T04:25:20.659 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stat_test 2024-09-17T04:25:20.931 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_encrypted_d_revalidate 2024-09-17T04:25:21.077 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr_replace_test 2024-09-17T04:25:21.221 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] swapon 2024-09-17T04:25:21.370 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mkswap 2024-09-17T04:25:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_attr_corruption 2024-09-17T04:25:21.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:25:21.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:25:21.639 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_open_tmpfiles 2024-09-17T04:25:21.801 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fscrypt-crypt-util 2024-09-17T04:25:22.427 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_null_ocount 2024-09-17T04:25:22.568 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice-test 2024-09-17T04:25:22.731 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] chprojid_fail 2024-09-17T04:25:22.877 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] detached_mounts_propagation 2024-09-17T04:25:23.042 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ext4_resize 2024-09-17T04:25:23.176 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_3 2024-09-17T04:25:23.352 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice2pipe 2024-09-17T04:25:23.496 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] uuid_ioctl 2024-09-17T04:25:23.634 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-17T04:25:23.782 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fiemap-fault 2024-09-17T04:25:23.924 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] min_dio_alignment 2024-09-17T04:25:24.061 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fiemap-tester 2024-09-17T04:25:24.304 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_stripealign 2024-09-17T04:25:24.442 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_by_handle 2024-09-17T04:25:24.671 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dbtest 2024-09-17T04:25:24.910 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_dio 2024-09-17T04:25:25.057 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsfind 2024-09-17T04:25:25.234 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_reflink_read_race 2024-09-17T04:25:25.409 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fssum 2024-09-17T04:25:25.825 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-09-17T04:25:25.830 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] replay-log 2024-09-17T04:25:26.122 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-09-17T04:25:26.125 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-09-17T04:25:26.132 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiocp 2024-09-17T04:25:26.340 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-17T04:25:26.490 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-read-race 2024-09-17T04:25:26.646 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cow-race 2024-09-17T04:25:26.781 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cycle-write 2024-09-17T04:25:26.946 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-eof-race 2024-09-17T04:25:27.110 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-extend-stat 2024-09-17T04:25:27.254 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-fcntl-race 2024-09-17T04:25:27.398 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-hole-filling-race 2024-09-17T04:25:27.527 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-failure 2024-09-17T04:25:27.671 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-readahead 2024-09-17T04:25:27.818 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiodio_sparse2 2024-09-17T04:25:28.015 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-subblock-eof-read 2024-09-17T04:25:28.140 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-write-verify 2024-09-17T04:25:28.316 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-17T04:25:28.433 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-17T04:25:28.549 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-last-ref-held-by-io 2024-09-17T04:25:28.706 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-09-17T04:25:28.712 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] vfstest 2024-09-17T04:25:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mount-idmapped 2024-09-17T04:25:32.531 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2024-09-17T04:25:32.534 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2024-09-17T04:25:32.538 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2024-09-17T04:25:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2024-09-17T04:25:32.549 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/btrfs/group.list 2024-09-17T04:25:32.615 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2024-09-17T04:25:32.620 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ceph/group.list 2024-09-17T04:25:32.636 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2024-09-17T04:25:32.641 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/cifs/group.list 2024-09-17T04:25:32.654 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2024-09-17T04:25:32.659 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ext4/group.list 2024-09-17T04:25:32.700 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2024-09-17T04:25:32.705 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/f2fs/group.list 2024-09-17T04:25:32.725 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2024-09-17T04:25:32.731 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/generic/group.list 2024-09-17T04:25:32.835 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2024-09-17T04:25:32.840 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/nfs/group.list 2024-09-17T04:25:32.855 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2024-09-17T04:25:32.861 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ocfs2/group.list 2024-09-17T04:25:32.875 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2024-09-17T04:25:32.880 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/overlay/group.list 2024-09-17T04:25:32.924 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-09-17T04:25:32.929 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/perf/group.list 2024-09-17T04:25:32.941 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2024-09-17T04:25:32.946 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/selftest/group.list 2024-09-17T04:25:32.960 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2024-09-17T04:25:32.965 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/tmpfs/group.list 2024-09-17T04:25:32.979 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2024-09-17T04:25:32.984 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/udf/group.list 2024-09-17T04:25:32.996 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2024-09-17T04:25:33.003 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/xfs/group.list 2024-09-17T04:25:33.112 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.9Nr4XTowM0xfstests-dev && exec sudo make install) 2024-09-17T04:25:33.190 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2024-09-17T04:25:33.194 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2024-09-17T04:25:33.201 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2024-09-17T04:25:33.202 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2024-09-17T04:25:33.237 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-09-17T04:25:33.241 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-09-17T04:25:33.244 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-09-17T04:25:33.249 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-09-17T04:25:33.253 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2024-09-17T04:25:33.256 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2024-09-17T04:25:33.260 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2024-09-17T04:25:33.265 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2024-09-17T04:25:33.271 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/btrfs/group.list 2024-09-17T04:25:33.336 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2024-09-17T04:25:33.341 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ceph/group.list 2024-09-17T04:25:33.357 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2024-09-17T04:25:33.362 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/cifs/group.list 2024-09-17T04:25:33.375 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2024-09-17T04:25:33.380 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ext4/group.list 2024-09-17T04:25:33.421 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2024-09-17T04:25:33.426 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/f2fs/group.list 2024-09-17T04:25:33.445 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2024-09-17T04:25:33.452 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/generic/group.list 2024-09-17T04:25:33.554 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2024-09-17T04:25:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/nfs/group.list 2024-09-17T04:25:33.575 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2024-09-17T04:25:33.580 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ocfs2/group.list 2024-09-17T04:25:33.595 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2024-09-17T04:25:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/overlay/group.list 2024-09-17T04:25:33.643 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-09-17T04:25:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/perf/group.list 2024-09-17T04:25:33.660 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2024-09-17T04:25:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/selftest/group.list 2024-09-17T04:25:33.679 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2024-09-17T04:25:33.684 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/tmpfs/group.list 2024-09-17T04:25:33.699 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2024-09-17T04:25:33.704 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/udf/group.list 2024-09-17T04:25:33.716 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2024-09-17T04:25:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/xfs/group.list 2024-09-17T04:25:33.825 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-09-17T04:25:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-17T04:25:33.827 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-09-17T04:25:33.829 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-17T04:25:33.830 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-09-17T04:25:33.831 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-09-17T04:25:33.841 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-09-17T04:25:33.913 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-09-17T04:25:33.922 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-09-17T04:25:33.939 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2024-09-17T04:25:33.943 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2024-09-17T04:25:33.946 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2024-09-17T04:25:33.951 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2024-09-17T04:25:33.954 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C log-writes install 2024-09-17T04:25:33.955 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-09-17T04:25:33.965 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-09-17T04:25:33.974 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C perf install 2024-09-17T04:25:33.975 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-09-17T04:25:33.985 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-09-17T04:25:34.007 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-09-17T04:25:34.009 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-09-17T04:25:34.018 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-09-17T04:25:34.070 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C vfs install 2024-09-17T04:25:34.072 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-09-17T04:25:34.081 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-09-17T04:25:34.093 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-09-17T04:25:34.102 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames dio-append-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault min_dio_alignment fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-09-17T04:25:35.347 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-09-17T04:25:35.446 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-09-17T04:25:35.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-09-17T04:25:35.473 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-17T04:25:35.473 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-09-17T04:25:35.474 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-09-17T04:25:35.483 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-09-17T04:25:35.624 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-09-17T04:25:35.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/btrfs/ install 2024-09-17T04:25:35.629 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/btrfs/group.list 2024-09-17T04:25:35.695 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-09-17T04:25:35.703 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 330 331 332 /var/lib/xfstests/tests/btrfs 2024-09-17T04:25:36.572 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-09-17T04:25:36.581 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 330.out 331.out 332.out /var/lib/xfstests/tests/btrfs 2024-09-17T04:25:37.455 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ceph/ install 2024-09-17T04:25:37.458 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ceph/group.list 2024-09-17T04:25:37.472 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-09-17T04:25:37.481 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-09-17T04:25:37.501 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-09-17T04:25:37.510 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-09-17T04:25:37.529 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/cifs/ install 2024-09-17T04:25:37.532 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/cifs/group.list 2024-09-17T04:25:37.546 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-09-17T04:25:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-09-17T04:25:37.564 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-09-17T04:25:37.573 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-09-17T04:25:37.582 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ext4/ install 2024-09-17T04:25:37.585 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ext4/group.list 2024-09-17T04:25:37.624 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-09-17T04:25:37.633 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-09-17T04:25:37.819 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-09-17T04:25:37.828 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-09-17T04:25:38.024 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/f2fs/ install 2024-09-17T04:25:38.027 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/f2fs/group.list 2024-09-17T04:25:38.045 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-09-17T04:25:38.054 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 /var/lib/xfstests/tests/f2fs 2024-09-17T04:25:38.071 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-09-17T04:25:38.080 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out /var/lib/xfstests/tests/f2fs 2024-09-17T04:25:38.097 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/generic/ install 2024-09-17T04:25:38.100 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/generic/group.list 2024-09-17T04:25:38.205 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-09-17T04:25:38.214 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 /var/lib/xfstests/tests/generic 2024-09-17T04:25:40.235 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-09-17T04:25:40.244 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out /var/lib/xfstests/tests/generic 2024-09-17T04:25:42.291 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/nfs/ install 2024-09-17T04:25:42.293 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/nfs/group.list 2024-09-17T04:25:42.307 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-09-17T04:25:42.316 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-09-17T04:25:42.325 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-09-17T04:25:42.334 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-09-17T04:25:42.343 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ocfs2/ install 2024-09-17T04:25:42.346 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/ocfs2/group.list 2024-09-17T04:25:42.359 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-09-17T04:25:42.368 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-09-17T04:25:42.377 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-09-17T04:25:42.386 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-09-17T04:25:42.395 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/overlay/ install 2024-09-17T04:25:42.398 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/overlay/group.list 2024-09-17T04:25:42.440 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-09-17T04:25:42.449 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-09-17T04:25:42.734 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-09-17T04:25:42.743 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-09-17T04:25:43.030 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/perf/ install 2024-09-17T04:25:43.032 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/perf/group.list 2024-09-17T04:25:43.043 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-09-17T04:25:43.052 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-09-17T04:25:43.061 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-09-17T04:25:43.070 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-09-17T04:25:43.079 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/selftest/ install 2024-09-17T04:25:43.082 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/selftest/group.list 2024-09-17T04:25:43.094 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-09-17T04:25:43.103 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-09-17T04:25:43.125 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-09-17T04:25:43.134 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-09-17T04:25:43.156 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/tmpfs/ install 2024-09-17T04:25:43.159 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/tmpfs/group.list 2024-09-17T04:25:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-09-17T04:25:43.181 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-09-17T04:25:43.190 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-09-17T04:25:43.199 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-09-17T04:25:43.208 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/udf/ install 2024-09-17T04:25:43.211 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/udf/group.list 2024-09-17T04:25:43.222 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-09-17T04:25:43.231 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-09-17T04:25:43.240 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-09-17T04:25:43.249 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-09-17T04:25:43.258 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/xfs/ install 2024-09-17T04:25:43.261 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.9Nr4XTowM0xfstests-dev/tests/xfs/group.list 2024-09-17T04:25:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-09-17T04:25:43.375 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 /var/lib/xfstests/tests/xfs 2024-09-17T04:25:45.311 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-09-17T04:25:45.320 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 021.out.default 021.out.parent 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 614.out.lba1024 614.out.lba2048 614.out.lba4096 614.out.lba512 021.cfg 033.cfg 216.cfg 614.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 612.out 613.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out 801.out /var/lib/xfstests/tests/xfs 2024-09-17T04:25:47.295 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-09-17T04:25:47.304 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-09-17T04:25:47.313 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-09-17T04:25:47.322 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-09-17T04:25:47.333 INFO:tasks.cephfs.test_acls:client is kernel mounted 2024-09-17T04:25:47.333 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T04:25:47.333 DEBUG:teuthology.orchestra.run.smithi063:running tests for ACLs from xfstests-dev> (cd /tmp/tmp.9Nr4XTowM0xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-09-17T04:25:47.586 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2024-09-17T04:25:47.590 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-17T04:25:47.590 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2024-09-17T04:25:47.591 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD/A+lmT5vzBhAAsvSi2Wv5T0EX/m1Jqjk7Jg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.Veb0Rzel4mscratch 2024-09-17T04:25:47.591 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:48.378 INFO:teuthology.orchestra.run.smithi063.stdout:generic/099 1s 2024-09-17T04:25:48.385 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/099 2024-09-17T04:25:48.385 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2024-09-17T04:25:48.387 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:48.444 INFO:tasks.cephfs.test_acls:Command return value: 0 2024-09-17T04:25:48.444 INFO:tasks.cephfs.test_acls:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi063 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 MKFS_OPTIONS -- 172.21.15.63:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQD/A+lmT5vzBhAAsvSi2Wv5T0EX/m1Jqjk7Jg== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.Veb0Rzel4mscratch generic/099 1s Ran: generic/099 Passed all 1 tests 2024-09-17T04:25:48.444 INFO:tasks.cephfs.test_acls:Command stderr - 2024-09-17T04:25:48.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo userdel --force --remove fsgqa 2024-09-17T04:25:49.051 DEBUG:teuthology.orchestra.run.smithi063:> sudo userdel --force --remove 123456-fsgqa 2024-09-17T04:25:49.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo groupdel fsgqa 2024-09-17T04:25:49.665 INFO:teuthology.orchestra.run.smithi063.stderr:groupdel: group 'fsgqa' does not exist 2024-09-17T04:25:49.667 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T04:25:49.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:49.667 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.9Nr4XTowM0xfstests-dev/results) 2024-09-17T04:25:49.733 INFO:teuthology.orchestra.run.smithi063.stdout: File: /tmp/tmp.9Nr4XTowM0xfstests-dev/results 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 801h/2049d Inode: 524289 Links: 3 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-17 04:25:47.570055147 +0000 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-17 04:25:48.383045651 +0000 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-17 04:25:48.383045651 +0000 2024-09-17T04:25:49.734 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-17 04:25:47.570055147 +0000 2024-09-17T04:25:49.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:49.735 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-09-17T04:25:49.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:49.802 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.9Nr4XTowM0xfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-09-17T04:25:49.869 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.9Nr4XTowM0xfstests-dev to /var/log/ceph. 2024-09-17T04:25:49.869 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf /tmp/tmp.9Nr4XTowM0xfstests-dev 2024-09-17T04:25:49.995 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T04:25:49.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T04:25:50.035 DEBUG:teuthology.orchestra.run.smithi112:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T04:25:50.085 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T04:25:50.086 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T04:25:50.086 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:25:50.086 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:50.103 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:25:50.103 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:50.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T04:25:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 -- 172.21.15.63:0/3337920750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91500ceb40 msgr2=0x7f91500cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 --2- 172.21.15.63:0/3337920750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91500ceb40 0x7f91500cef50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f91500ba570 tx=0x7f914002aa70 comp rx=0 tx=0).stop 2024-09-17T04:25:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 -- 172.21.15.63:0/3337920750 shutdown_connections 2024-09-17T04:25:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 --2- 172.21.15.63:0/3337920750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91500ceb40 0x7f91500cef50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 --2- 172.21.15.63:0/3337920750 >> v2:172.21.15.112:3300/0 conn(0x7f915006e170 0x7f91500b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 -- 172.21.15.63:0/3337920750 >> 172.21.15.63:0/3337920750 conn(0x7f915008bfc0 msgr2=0x7f915009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 -- 172.21.15.63:0/3337920750 shutdown_connections 2024-09-17T04:25:50.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.319+0000 7f91552a9640 1 -- 172.21.15.63:0/3337920750 wait complete. 2024-09-17T04:25:50.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.321+0000 7f91552a9640 1 Processor -- start 2024-09-17T04:25:50.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.321+0000 7f91552a9640 1 -- start start 2024-09-17T04:25:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 0x7f91500cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91500cd630 0x7f91501584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91500d0e60 con 0x7f915006f4b0 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f91500d0ce0 con 0x7f91500ceb40 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.322+0000 7f91552a9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f91500d0fe0 con 0x7f91500cd630 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36818/0 (socket says 172.21.15.63:36818) 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 -- 172.21.15.63:0/1022201588 learned_addr learned my addr 172.21.15.63:0/1022201588 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914f7fe640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91500cd630 0x7f91501584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914e7fc640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 0x7f91500cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 -- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91500cd630 msgr2=0x7f91501584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91500cd630 0x7f91501584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 -- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 msgr2=0x7f91500cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 0x7f91500cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 -- 172.21.15.63:0/1022201588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91501f9950 con 0x7f915006f4b0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914e7fc640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 0x7f91500cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f914effd640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f914800c970 tx=0x7f914800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148007bb0 con 0x7f915006f4b0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9148007e40 con 0x7f915006f4b0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91501f5800 con 0x7f915006f4b0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148005280 con 0x7f915006f4b0 2024-09-17T04:25:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.323+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91501f5dc0 con 0x7f915006f4b0 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.324+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91500d1510 con 0x7f915006f4b0 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.325+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9148005420 con 0x7f915006f4b0 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.326+0000 7f91477fe640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 0x7f913007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.326+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f914809b200 con 0x7f915006f4b0 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.326+0000 7f914e7fc640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 0x7f913007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.327+0000 7f914e7fc640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 0x7f913007b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f915008e730 tx=0x7f9138009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:50.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.331+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9148014030 con 0x7f915006f4b0 2024-09-17T04:25:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.529+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91500cf660 con 0x7f915006f4b0 2024-09-17T04:25:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.529+0000 7f91477fe640 1 -- 172.21.15.63:0/1022201588 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f9148063700 con 0x7f915006f4b0 2024-09-17T04:25:50.529 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-17T04:25:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 msgr2=0x7f913007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 0x7f913007b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f915008e730 tx=0x7f9138009040 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 msgr2=0x7f915009e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f914800c970 tx=0x7f914800ce30 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 shutdown_connections 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9130078b90 0x7f913007b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f91500ceb40 0x7f91500cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f91500cd630 0x7f91501584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 --2- 172.21.15.63:0/1022201588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f915006f4b0 0x7f915009e850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 >> 172.21.15.63:0/1022201588 conn(0x7f915008bfc0 msgr2=0x7f91501616e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 shutdown_connections 2024-09-17T04:25:50.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.531+0000 7f91552a9640 1 -- 172.21.15.63:0/1022201588 wait complete. 2024-09-17T04:25:50.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T04:25:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:50.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T04:25:50.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:25:50.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:50.573 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T04:25:50.629 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T04:25:50.629 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:25:50.630 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:50.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T04:25:50.649 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T04:25:50.649 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:25:50.649 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:50.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=602 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T04:25:50.686 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T04:25:50.686 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:25:50.686 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:50.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T04:25:50.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:25:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 -- 172.21.15.63:0/3420498239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740b9be0 msgr2=0x7ff1740d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 --2- 172.21.15.63:0/3420498239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740b9be0 0x7ff1740d4510 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff164009830 tx=0x7ff16402a5c0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 -- 172.21.15.63:0/3420498239 shutdown_connections 2024-09-17T04:25:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 --2- 172.21.15.63:0/3420498239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740b9be0 0x7ff1740d4510 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 -- 172.21.15.63:0/3420498239 >> 172.21.15.63:0/3420498239 conn(0x7ff17408bfc0 msgr2=0x7ff17409d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 -- 172.21.15.63:0/3420498239 shutdown_connections 2024-09-17T04:25:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.842+0000 7ff17c29b640 1 -- 172.21.15.63:0/3420498239 wait complete. 2024-09-17T04:25:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.844+0000 7ff17c29b640 1 Processor -- start 2024-09-17T04:25:50.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.844+0000 7ff17c29b640 1 -- start start 2024-09-17T04:25:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1740b9be0 0x7ff17409edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1740d0ce0 0x7ff17409f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740b4c60 con 0x7ff1740d4a50 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740b4ae0 con 0x7ff1740d0ce0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17c29b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740b4de0 con 0x7ff1740b9be0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.845+0000 7ff17a838640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44958/0 (socket says 172.21.15.63:44958) 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 -- 172.21.15.63:0/802538650 learned_addr learned my addr 172.21.15.63:0/802538650 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff179836640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1740d0ce0 0x7ff17409f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 -- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1740b9be0 msgr2=0x7ff17409edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a037640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1740b9be0 0x7ff17409edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1740b9be0 0x7ff17409edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 -- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1740d0ce0 msgr2=0x7ff17409f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1740d0ce0 0x7ff17409f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 -- 172.21.15.63:0/802538650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1740cd030 con 0x7ff1740d4a50 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17a838640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00c760 tx=0x7ff16c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c003b70 con 0x7ff1740d4a50 2024-09-17T04:25:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff16c003d10 con 0x7ff1740d4a50 2024-09-17T04:25:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1740cd310 con 0x7ff1740d4a50 2024-09-17T04:25:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c005330 con 0x7ff1740d4a50 2024-09-17T04:25:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.846+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1740cd8d0 con 0x7ff1740d4a50 2024-09-17T04:25:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.847+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1740b5300 con 0x7ff1740d4a50 2024-09-17T04:25:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.848+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff16c0054d0 con 0x7ff1740d4a50 2024-09-17T04:25:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.848+0000 7ff16affd640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 0x7ff15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.849+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff16c09ab20 con 0x7ff1740d4a50 2024-09-17T04:25:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.849+0000 7ff17a037640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 0x7ff15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.849+0000 7ff17a037640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 0x7ff15807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1700046b0 tx=0x7ff170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:50.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:50.853+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff16c062ec0 con 0x7ff1740d4a50 2024-09-17T04:25:51.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.073+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1740ccdc0 con 0x7ff1740d4a50 2024-09-17T04:25:51.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.073+0000 7ff16affd640 1 -- 172.21.15.63:0/802538650 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7ff16c0627c0 con 0x7ff1740d4a50 2024-09-17T04:25:51.073 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:51.074 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:25:51.074 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 msgr2=0x7ff15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 0x7ff15807b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1700046b0 tx=0x7ff170009040 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 msgr2=0x7ff1741f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00c760 tx=0x7ff16c00cb60 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 shutdown_connections 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff158078b90 0x7ff15807b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1740d0ce0 0x7ff17409f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1740d4a50 0x7ff1741f9060 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 --2- 172.21.15.63:0/802538650 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1740b9be0 0x7ff17409edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 >> 172.21.15.63:0/802538650 conn(0x7ff17408bfc0 msgr2=0x7ff1740d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 shutdown_connections 2024-09-17T04:25:51.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.076+0000 7ff17c29b640 1 -- 172.21.15.63:0/802538650 wait complete. 2024-09-17T04:25:51.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:25:51.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.204+0000 7f4f809da640 1 -- 172.21.15.63:0/189868406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f64003c10 msgr2=0x7f4f64004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.204+0000 7f4f809da640 1 --2- 172.21.15.63:0/189868406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f64003c10 0x7f4f64004060 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c006f70 tx=0x7f4f64005830 comp rx=0 tx=0).stop 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.204+0000 7f4f7ad9d640 1 -- 172.21.15.63:0/189868406 reap_dead start 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.205+0000 7f4f809da640 1 -- 172.21.15.63:0/189868406 shutdown_connections 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.205+0000 7f4f809da640 1 -- 172.21.15.63:0/189868406 >> 172.21.15.63:0/189868406 conn(0x7f4f7c0d12a0 msgr2=0x7f4f7c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.205+0000 7f4f809da640 1 -- 172.21.15.63:0/189868406 shutdown_connections 2024-09-17T04:25:51.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.205+0000 7f4f809da640 1 -- 172.21.15.63:0/189868406 wait complete. 2024-09-17T04:25:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.207+0000 7f4f809da640 1 Processor -- start 2024-09-17T04:25:51.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.207+0000 7f4f809da640 1 -- start start 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 0x7f4f7c1f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c15f120 0x7f4f7c15f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b1880 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b1700 con 0x7f4f7c15f120 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f809da640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c0b2090 con 0x7f4f64003c10 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44984/0 (socket says 172.21.15.63:44984) 2024-09-17T04:25:51.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 -- 172.21.15.63:0/2769909193 learned_addr learned my addr 172.21.15.63:0/2769909193 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f7a59c640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 0x7f4f7c1f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f7ad9d640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c15f120 0x7f4f7c15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 -- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 msgr2=0x7f4f7c1f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 0x7f4f7c1f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 -- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c15f120 msgr2=0x7f4f7c15f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c15f120 0x7f4f7c15f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f79d9b640 1 -- 172.21.15.63:0/2769909193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c15fa70 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.208+0000 7f4f7a59c640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 0x7f4f7c1f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f79d9b640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f70011d90 tx=0x7f4f7000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70003d80 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f70004b20 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c15c970 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70004050 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.209+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c0ccdf0 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.210+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c0cc880 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.211+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f700041f0 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.211+0000 7f4f6affd640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 0x7f4f5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.211+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4f7009c000 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.211+0000 7f4f7a59c640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 0x7f4f5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.212+0000 7f4f7a59c640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 0x7f4f5c07b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c033000 tx=0x7f4f6c02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.216+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f7c15fa70 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.441+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f7c0b0de0 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.441+0000 7f4f6affd640 1 -- 172.21.15.63:0/2769909193 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f4f70064450 con 0x7f4f7c0cdbb0 2024-09-17T04:25:51.441 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:51.441 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:25:51.441 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:25:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 msgr2=0x7f4f5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 0x7f4f5c07b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c033000 tx=0x7f4f6c02d000 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 msgr2=0x7f4f7c0cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f70011d90 tx=0x7f4f7000f790 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 shutdown_connections 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4f5c078b90 0x7f4f5c07b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f4f7c15f120 0x7f4f7c15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0cdbb0 0x7f4f7c0cb050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 --2- 172.21.15.63:0/2769909193 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f4f64003c10 0x7f4f7c1f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 >> 172.21.15.63:0/2769909193 conn(0x7f4f7c0d12a0 msgr2=0x7f4f7c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 shutdown_connections 2024-09-17T04:25:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.444+0000 7f4f809da640 1 -- 172.21.15.63:0/2769909193 wait complete. 2024-09-17T04:25:51.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 -- 172.21.15.63:0/1342846043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070440 msgr2=0x7f3ab00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 --2- 172.21.15.63:0/1342846043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070440 0x7f3ab00b3090 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0070e70 tx=0x7f3aa802a820 comp rx=0 tx=0).stop 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 -- 172.21.15.63:0/1342846043 shutdown_connections 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 --2- 172.21.15.63:0/1342846043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070440 0x7f3ab00b3090 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 --2- 172.21.15.63:0/1342846043 >> v2:172.21.15.112:3300/0 conn(0x7f3ab0073170 0x7f3ab015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 -- 172.21.15.63:0/1342846043 >> 172.21.15.63:0/1342846043 conn(0x7f3ab00b1cb0 msgr2=0x7f3ab00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 -- 172.21.15.63:0/1342846043 shutdown_connections 2024-09-17T04:25:51.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.572+0000 7f3ab659b640 1 -- 172.21.15.63:0/1342846043 wait complete. 2024-09-17T04:25:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.574+0000 7f3ab659b640 1 Processor -- start 2024-09-17T04:25:51.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.574+0000 7f3ab659b640 1 -- start start 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab0070440 0x7f3ab01f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab0073170 0x7f3ab01f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00b3b00 con 0x7f3ab0070030 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab00b3980 con 0x7f3ab0073170 2024-09-17T04:25:51.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.575+0000 7f3ab659b640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab00b3c80 con 0x7f3ab0070440 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44996/0 (socket says 172.21.15.63:44996) 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 -- 172.21.15.63:0/3874206234 learned_addr learned my addr 172.21.15.63:0/3874206234 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3ab4b38640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab0073170 0x7f3ab01f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaf7fe640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab0070440 0x7f3ab01f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 -- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab0070440 msgr2=0x7f3ab01f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab0070440 0x7f3ab01f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 -- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab0073170 msgr2=0x7f3ab01f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab0073170 0x7f3ab01f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 -- 172.21.15.63:0/3874206234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01f7ae0 con 0x7f3ab0070030 2024-09-17T04:25:51.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aaffff640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000e790 tx=0x7f3aa000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000eea0 con 0x7f3ab0070030 2024-09-17T04:25:51.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa000cdb0 con 0x7f3ab0070030 2024-09-17T04:25:51.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab01e50b0 con 0x7f3ab0070030 2024-09-17T04:25:51.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0010690 con 0x7f3ab0070030 2024-09-17T04:25:51.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.576+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab009d270 con 0x7f3ab0070030 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.578+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab00b4130 con 0x7f3ab0070030 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.578+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3aa0010830 con 0x7f3ab0070030 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.579+0000 7f3aacff9640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 0x7f3a9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.579+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3aa009b6e0 con 0x7f3ab0070030 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.579+0000 7f3aaf7fe640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 0x7f3a9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.579+0000 7f3aaf7fe640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 0x7f3a9c07b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40046b0 tx=0x7f3aa4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.583+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3aa00634d0 con 0x7f3ab0070030 2024-09-17T04:25:51.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:25:51.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:25:51.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.770+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ab00c3860 con 0x7f3ab0070030 2024-09-17T04:25:51.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.771+0000 7f3aacff9640 1 -- 172.21.15.63:0/3874206234 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7f3aa0067f00 con 0x7f3ab0070030 2024-09-17T04:25:51.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:51.771 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:24:07.168292+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:24:03.608048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T04:24:04.496167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:25:51.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 msgr2=0x7f3a9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 0x7f3a9c07b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40046b0 tx=0x7f3aa4007e90 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 msgr2=0x7f3ab014e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000e790 tx=0x7f3aa000ec50 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 shutdown_connections 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3a9c078bc0 0x7f3a9c07b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3ab0073170 0x7f3ab01f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3ab0070440 0x7f3ab01f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 --2- 172.21.15.63:0/3874206234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ab0070030 0x7f3ab014e4a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 >> 172.21.15.63:0/3874206234 conn(0x7f3ab00b1cb0 msgr2=0x7f3ab00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.773+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 shutdown_connections 2024-09-17T04:25:51.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.774+0000 7f3ab659b640 1 -- 172.21.15.63:0/3874206234 wait complete. 2024-09-17T04:25:51.785 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T04:25:51.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 -- 172.21.15.63:0/1664266474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 msgr2=0x7fb6ec162840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1664266474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec162840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec06d610 tx=0x7fb6e402a4d0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 -- 172.21.15.63:0/1664266474 shutdown_connections 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1664266474 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec162840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1664266474 >> v2:172.21.15.112:3300/0 conn(0x7fb6ec0b3a10 0x7fb6ec0d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1664266474 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b9b60 0x7fb6ec0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 -- 172.21.15.63:0/1664266474 >> 172.21.15.63:0/1664266474 conn(0x7fb6ec09d8f0 msgr2=0x7fb6ec0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 -- 172.21.15.63:0/1664266474 shutdown_connections 2024-09-17T04:25:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.941+0000 7fb6f141d640 1 -- 172.21.15.63:0/1664266474 wait complete. 2024-09-17T04:25:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.943+0000 7fb6f141d640 1 Processor -- start 2024-09-17T04:25:51.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.943+0000 7fb6f141d640 1 -- start start 2024-09-17T04:25:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b3a10 0x7fb6ec0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ec0b9b60 0x7fb6ec0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec163110 con 0x7fb6ec162430 2024-09-17T04:25:51.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ec162f90 con 0x7fb6ec0b9b60 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6f141d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ec163290 con 0x7fb6ec0b3a10 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6eb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6eb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45018/0 (socket says 172.21.15.63:45018) 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6eb7fe640 1 -- 172.21.15.63:0/1560549276 learned_addr learned my addr 172.21.15.63:0/1560549276 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6eaffd640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b3a10 0x7fb6ec0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.944+0000 7fb6ea7fc640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ec0b9b60 0x7fb6ec0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 -- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b3a10 msgr2=0x7fb6ec0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b3a10 0x7fb6ec0b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 -- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ec0b9b60 msgr2=0x7fb6ec0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ec0b9b60 0x7fb6ec0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 -- 172.21.15.63:0/1560549276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ec0b66e0 con 0x7fb6ec162430 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6eb7fe640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009230 tx=0x7fb6e4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e403e030 con 0x7fb6ec162430 2024-09-17T04:25:51.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e4003e50 con 0x7fb6ec162430 2024-09-17T04:25:51.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4035040 con 0x7fb6ec162430 2024-09-17T04:25:51.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ec0b69c0 con 0x7fb6ec162430 2024-09-17T04:25:51.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.945+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ec0ca300 con 0x7fb6ec162430 2024-09-17T04:25:51.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.946+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ec0b6450 con 0x7fb6ec162430 2024-09-17T04:25:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.947+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6e4041030 con 0x7fb6ec162430 2024-09-17T04:25:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.947+0000 7fb6e37fe640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 0x7fb6cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.948+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb6e40bb530 con 0x7fb6ec162430 2024-09-17T04:25:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.948+0000 7fb6eaffd640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 0x7fb6cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:51.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.948+0000 7fb6eaffd640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 0x7fb6cc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc005fd0 tx=0x7fb6dc0095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:51.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:51.952+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6e40832a0 con 0x7fb6ec162430 2024-09-17T04:25:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.175+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6ec162840 con 0x7fb6ec162430 2024-09-17T04:25:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.176+0000 7fb6e37fe640 1 -- 172.21.15.63:0/1560549276 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7fb6e4087cd0 con 0x7fb6ec162430 2024-09-17T04:25:52.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:52.176 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:25:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:25:52.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 msgr2=0x7fb6cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 0x7fb6cc07b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc005fd0 tx=0x7fb6dc0095e0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 msgr2=0x7fb6ec14aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009230 tx=0x7fb6e4003960 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 shutdown_connections 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb6cc078b90 0x7fb6cc07b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb6ec0b9b60 0x7fb6ec0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6ec162430 0x7fb6ec14aac0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 --2- 172.21.15.63:0/1560549276 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb6ec0b3a10 0x7fb6ec0b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 >> 172.21.15.63:0/1560549276 conn(0x7fb6ec09d8f0 msgr2=0x7fb6ec0b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 shutdown_connections 2024-09-17T04:25:52.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.178+0000 7fb6f141d640 1 -- 172.21.15.63:0/1560549276 wait complete. 2024-09-17T04:25:52.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:25:52.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 -- 172.21.15.63:0/4245347952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0cf7a0 msgr2=0x7f732c1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 --2- 172.21.15.63:0/4245347952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0cf7a0 0x7f732c1626e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f732c08d4e0 tx=0x7f732402a8b0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 -- 172.21.15.63:0/4245347952 shutdown_connections 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 --2- 172.21.15.63:0/4245347952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0cf7a0 0x7f732c1626e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 --2- 172.21.15.63:0/4245347952 >> v2:172.21.15.112:3300/0 conn(0x7f732c0d2ed0 0x7f732c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.305+0000 7f7333663640 1 -- 172.21.15.63:0/4245347952 >> 172.21.15.63:0/4245347952 conn(0x7f732c08bfc0 msgr2=0x7f732c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.306+0000 7f7333663640 1 -- 172.21.15.63:0/4245347952 shutdown_connections 2024-09-17T04:25:52.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.306+0000 7f7333663640 1 -- 172.21.15.63:0/4245347952 wait complete. 2024-09-17T04:25:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.307+0000 7f7333663640 1 Processor -- start 2024-09-17T04:25:52.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.307+0000 7f7333663640 1 -- start start 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f732c0cf7a0 0x7f732c09f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f732c0d2ed0 0x7f732c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f732c162c20 con 0x7f732c0b9b70 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f732c0cfed0 con 0x7f732c0d2ed0 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7333663640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f732c162da0 con 0x7f732c0cf7a0 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45038/0 (socket says 172.21.15.63:45038) 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 -- 172.21.15.63:0/2963550569 learned_addr learned my addr 172.21.15.63:0/2963550569 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7331c00640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f732c0d2ed0 0x7f732c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f7330bfe640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f732c0cf7a0 0x7f732c09f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 -- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f732c0cf7a0 msgr2=0x7f732c09f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f732c0cf7a0 0x7f732c09f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 -- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f732c0d2ed0 msgr2=0x7f732c153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f732c0d2ed0 0x7f732c153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 -- 172.21.15.63:0/2963550569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c09ff10 con 0x7f732c0b9b70 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.309+0000 7f73313ff640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f732800c970 tx=0x7f732800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.310+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328007bb0 con 0x7f732c0b9b70 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.310+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c152660 con 0x7f732c0b9b70 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.310+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7328007e40 con 0x7f732c0b9b70 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.310+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328005290 con 0x7f732c0b9b70 2024-09-17T04:25:52.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.310+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c152c20 con 0x7f732c0b9b70 2024-09-17T04:25:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.311+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c151d40 con 0x7f732c0b9b70 2024-09-17T04:25:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.311+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7328005430 con 0x7f732c0b9b70 2024-09-17T04:25:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.312+0000 7f7321ffb640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 0x7f731007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.312+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f732809b1d0 con 0x7f732c0b9b70 2024-09-17T04:25:52.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.312+0000 7f7330bfe640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 0x7f731007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.313+0000 7f7330bfe640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 0x7f731007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f731c000f60 tx=0x7f731c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.316+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7328014070 con 0x7f732c0b9b70 2024-09-17T04:25:52.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.539+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f732c163330 con 0x7f732c0b9b70 2024-09-17T04:25:52.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.539+0000 7f7321ffb640 1 -- 172.21.15.63:0/2963550569 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f7328062fd0 con 0x7f732c0b9b70 2024-09-17T04:25:52.540 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:52.541 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-17T04:24:09:182596+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T04:24:05.537623+0000","modified":"2024-09-17T04:24:08.565506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6834/1995424855","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1995424855},{"type":"v1","addr":"172.21.15.63:6834","nonce":1995424855}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-17T04:25:52.541 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 msgr2=0x7f731007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 0x7f731007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f731c000f60 tx=0x7f731c009040 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 msgr2=0x7f732c0ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f732800c970 tx=0x7f732800ce30 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 shutdown_connections 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7310078bc0 0x7f731007b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f732c0d2ed0 0x7f732c153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f732c0cf7a0 0x7f732c09f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 --2- 172.21.15.63:0/2963550569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f732c0b9b70 0x7f732c0ce540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 >> 172.21.15.63:0/2963550569 conn(0x7f732c08bfc0 msgr2=0x7f732c0d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 shutdown_connections 2024-09-17T04:25:52.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.542+0000 7f7333663640 1 -- 172.21.15.63:0/2963550569 wait complete. 2024-09-17T04:25:52.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 -- 172.21.15.63:0/655506162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdab8003c10 msgr2=0x7fdab8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 --2- 172.21.15.63:0/655506162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdab8003c10 0x7fdab8004060 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdac0001830 tx=0x7fdab8005830 comp rx=0 tx=0).stop 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad4a69640 1 -- 172.21.15.63:0/655506162 reap_dead start 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 -- 172.21.15.63:0/655506162 shutdown_connections 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 -- 172.21.15.63:0/655506162 >> 172.21.15.63:0/655506162 conn(0x7fdad006def0 msgr2=0x7fdad006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 -- 172.21.15.63:0/655506162 shutdown_connections 2024-09-17T04:25:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.673+0000 7fdad64cc640 1 -- 172.21.15.63:0/655506162 wait complete. 2024-09-17T04:25:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.675+0000 7fdad64cc640 1 Processor -- start 2024-09-17T04:25:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.675+0000 7fdad64cc640 1 -- start start 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8003c10 0x7fdad0160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdad014c800 0x7fdad01607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdad0164640 con 0x7fdad014cd20 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fdad01644c0 con 0x7fdab8003c10 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad64cc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fdad01647c0 con 0x7fdad014c800 2024-09-17T04:25:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad4a69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad4a69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45050/0 (socket says 172.21.15.63:45050) 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdad4a69640 1 -- 172.21.15.63:0/2082757176 learned_addr learned my addr 172.21.15.63:0/2082757176 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdacffff640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8003c10 0x7fdad0160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.676+0000 7fdacf7fe640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdad014c800 0x7fdad01607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 -- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdad014c800 msgr2=0x7fdad01607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdad014c800 0x7fdad01607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 -- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8003c10 msgr2=0x7fdad0160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8003c10 0x7fdad0160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 -- 172.21.15.63:0/2082757176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad014e190 con 0x7fdad014cd20 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad4a69640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005fd0 tx=0x7fdac800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8004b20 con 0x7fdad014cd20 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac8004cc0 con 0x7fdad014cd20 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad014e670 con 0x7fdad014cd20 2024-09-17T04:25:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8003bd0 con 0x7fdad014cd20 2024-09-17T04:25:52.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.677+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad014ec30 con 0x7fdad014cd20 2024-09-17T04:25:52.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.678+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad015c580 con 0x7fdad014cd20 2024-09-17T04:25:52.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.679+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdac8004030 con 0x7fdad014cd20 2024-09-17T04:25:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.679+0000 7fdaccff9640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.680+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdac809b1f0 con 0x7fdad014cd20 2024-09-17T04:25:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.680+0000 7fdacffff640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.680+0000 7fdacffff640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdac0032000 tx=0x7fdac0001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.684+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdad014e190 con 0x7fdad014cd20 2024-09-17T04:25:52.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.871+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdad00b1700 con 0x7fdad014cd20 2024-09-17T04:25:52.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.872+0000 7fdaccff9640 1 -- 172.21.15.63:0/2082757176 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16705 (secure 0 0 0) 0x7fdac8063630 con 0x7fdad014cd20 2024-09-17T04:25:52.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:52.873 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:24:07.168292+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T04:24:03.608048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T04:24:04.496167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:25:52.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 msgr2=0x7fdabc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdac0032000 tx=0x7fdac0001360 comp rx=0 tx=0).stop 2024-09-17T04:25:52.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 msgr2=0x7fdad01623f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:52.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdac8005fd0 tx=0x7fdac800f3c0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 shutdown_connections 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdad014cd20 0x7fdad01623f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fdad014c800 0x7fdad01607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 --2- 172.21.15.63:0/2082757176 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fdab8003c10 0x7fdad0160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 >> 172.21.15.63:0/2082757176 conn(0x7fdad006def0 msgr2=0x7fdad015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 shutdown_connections 2024-09-17T04:25:52.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:52.874+0000 7fdad64cc640 1 -- 172.21.15.63:0/2082757176 wait complete. 2024-09-17T04:25:52.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 -- 172.21.15.63:0/4105530124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680cf540 msgr2=0x7f40680b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 --2- 172.21.15.63:0/4105530124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680cf540 0x7f40680b5fa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f405c009830 tx=0x7f405c02a3f0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 -- 172.21.15.63:0/4105530124 shutdown_connections 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 --2- 172.21.15.63:0/4105530124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680cf540 0x7f40680b5fa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 --2- 172.21.15.63:0/4105530124 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680b9b60 0x7f40680d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 -- 172.21.15.63:0/4105530124 >> 172.21.15.63:0/4105530124 conn(0x7f406809d7f0 msgr2=0x7f40680d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 -- 172.21.15.63:0/4105530124 shutdown_connections 2024-09-17T04:25:53.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.004+0000 7f406de38640 1 -- 172.21.15.63:0/4105530124 wait complete. 2024-09-17T04:25:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.005+0000 7f406de38640 1 Processor -- start 2024-09-17T04:25:53.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.006+0000 7f406de38640 1 -- start start 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 0x7f406814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 0x7f406815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40680d2e40 con 0x7f40680b64e0 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f40680d2cc0 con 0x7f40680b9b60 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f406de38640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f40680d2fc0 con 0x7f40680cf540 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45068/0 (socket says 172.21.15.63:45068) 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 -- 172.21.15.63:0/1749941999 learned_addr learned my addr 172.21.15.63:0/1749941999 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f4066ffd640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 0x7f406814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f4067fff640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 0x7f406815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 -- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 msgr2=0x7f406815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 0x7f406815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 -- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 msgr2=0x7f406814e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 0x7f406814e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f40677fe640 1 -- 172.21.15.63:0/1749941999 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406814e6b0 con 0x7f40680b64e0 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f4067fff640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 0x7f406815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.007+0000 7f4066ffd640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 0x7f406814e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f40677fe640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f405800e7c0 tx=0x7f405800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405800ccc0 con 0x7f40680b64e0 2024-09-17T04:25:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4058010430 con 0x7f40680b64e0 2024-09-17T04:25:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40680cdd80 con 0x7f40680b64e0 2024-09-17T04:25:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058010840 con 0x7f40680b64e0 2024-09-17T04:25:53.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.008+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40680ce340 con 0x7f40680b64e0 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.009+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40680d3470 con 0x7f40680b64e0 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.010+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40580109e0 con 0x7f40680b64e0 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.010+0000 7f404ffff640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 0x7f405407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.010+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f405809c0b0 con 0x7f40680b64e0 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.011+0000 7f4066ffd640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 0x7f405407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.011+0000 7f4066ffd640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 0x7f405407b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.014+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40580644e0 con 0x7f40680b64e0 2024-09-17T04:25:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.238+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f40680d3fb0 con 0x7f40680b64e0 2024-09-17T04:25:53.239 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-17T04:25:53.239+0000 7f547533d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T04:25:53.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.241+0000 7f404ffff640 1 -- 172.21.15.63:0/1749941999 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f4058063de0 con 0x7f40680b64e0 2024-09-17T04:25:53.241 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 msgr2=0x7f405407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 0x7f405407b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c004730 comp rx=0 tx=0).stop 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 msgr2=0x7f4068158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f405800e7c0 tx=0x7f405800ec80 comp rx=0 tx=0).stop 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 shutdown_connections 2024-09-17T04:25:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f4054078bc0 0x7f405407b0d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f40680b9b60 0x7f406814e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f40680cf540 0x7f406815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 --2- 172.21.15.63:0/1749941999 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40680b64e0 0x7f4068158d30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 >> 172.21.15.63:0/1749941999 conn(0x7f406809d7f0 msgr2=0x7f40681600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 shutdown_connections 2024-09-17T04:25:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.243+0000 7f406de38640 1 -- 172.21.15.63:0/1749941999 wait complete. 2024-09-17T04:25:53.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T04:25:53.315 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-17T04:25:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 -- 172.21.15.63:0/1508764786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff478005150 msgr2=0x7ff47800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1508764786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff478005150 0x7ff47800b9c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c8000 tx=0x7ff478005830 comp rx=0 tx=0).stop 2024-09-17T04:25:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff48ffff640 1 -- 172.21.15.63:0/1508764786 reap_dead start 2024-09-17T04:25:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 -- 172.21.15.63:0/1508764786 shutdown_connections 2024-09-17T04:25:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 -- 172.21.15.63:0/1508764786 >> 172.21.15.63:0/1508764786 conn(0x7ff49008bfc0 msgr2=0x7ff49009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 -- 172.21.15.63:0/1508764786 shutdown_connections 2024-09-17T04:25:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.382+0000 7ff495d3a640 1 -- 172.21.15.63:0/1508764786 wait complete. 2024-09-17T04:25:53.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.384+0000 7ff495d3a640 1 Processor -- start 2024-09-17T04:25:53.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.384+0000 7ff495d3a640 1 -- start start 2024-09-17T04:25:53.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.385+0000 7ff495d3a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff478005150 0x7ff490151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.385+0000 7ff495d3a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.385+0000 7ff495d3a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff490153770 0x7ff49015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.385+0000 7ff495d3a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4900d28c0 con 0x7ff490153360 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff495d3a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff4900d2740 con 0x7ff478005150 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff495d3a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff4900d2a40 con 0x7ff490153770 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45100/0 (socket says 172.21.15.63:45100) 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 -- 172.21.15.63:0/1521316990 learned_addr learned my addr 172.21.15.63:0/1521316990 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48f7fe640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff478005150 0x7ff490151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48ffff640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff490153770 0x7ff49015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 -- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff490153770 msgr2=0x7ff49015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff490153770 0x7ff49015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 -- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff478005150 msgr2=0x7ff490151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff478005150 0x7ff490151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 -- 172.21.15.63:0/1521316990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49015b110 con 0x7ff490153360 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff48effd640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff484011b10 tx=0x7ff484009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48401e070 con 0x7ff490153360 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff484004460 con 0x7ff490153360 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49015b3f0 con 0x7ff490153360 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48400fc70 con 0x7ff490153360 2024-09-17T04:25:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.386+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49015b9b0 con 0x7ff490153360 2024-09-17T04:25:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.387+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49006f7a0 con 0x7ff490153360 2024-09-17T04:25:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.388+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff484021070 con 0x7ff490153360 2024-09-17T04:25:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.389+0000 7ff477fff640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 0x7ff47c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.389+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7ff48409b850 con 0x7ff490153360 2024-09-17T04:25:53.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.389+0000 7ff48f7fe640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 0x7ff47c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:53.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.389+0000 7ff48f7fe640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 0x7ff47c07b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff49008c950 tx=0x7ff480005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.393+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4840635e0 con 0x7ff490153360 2024-09-17T04:25:53.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:53.617+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff490069080 con 0x7ff490153360 2024-09-17T04:25:54.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.242+0000 7ff477fff640 1 -- 172.21.15.63:0/1521316990 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7ff484068010 con 0x7ff490153360 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 msgr2=0x7ff47c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 0x7ff47c07b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff49008c950 tx=0x7ff480005f90 comp rx=0 tx=0).stop 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 msgr2=0x7ff4900b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff484011b10 tx=0x7ff484009eb0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 shutdown_connections 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff47c078bc0 0x7ff47c07b0d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff490153770 0x7ff49015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff490153360 0x7ff4900b5af0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 --2- 172.21.15.63:0/1521316990 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff478005150 0x7ff490151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 >> 172.21.15.63:0/1521316990 conn(0x7ff49008bfc0 msgr2=0x7ff4900cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 shutdown_connections 2024-09-17T04:25:54.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.245+0000 7ff495d3a640 1 -- 172.21.15.63:0/1521316990 wait complete. 2024-09-17T04:25:54.259 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 -- 172.21.15.63:0/63158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 msgr2=0x7fb37c06d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 --2- 172.21.15.63:0/63158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c06d660 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb37402aa90 comp rx=0 tx=0).stop 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 -- 172.21.15.63:0/63158613 shutdown_connections 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 --2- 172.21.15.63:0/63158613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c06d660 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 --2- 172.21.15.63:0/63158613 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c0cffd0 0x7fb37c0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 -- 172.21.15.63:0/63158613 >> 172.21.15.63:0/63158613 conn(0x7fb37c0b26f0 msgr2=0x7fb37c0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 -- 172.21.15.63:0/63158613 shutdown_connections 2024-09-17T04:25:54.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.383+0000 7fb381cbd640 1 -- 172.21.15.63:0/63158613 wait complete. 2024-09-17T04:25:54.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.384+0000 7fb381cbd640 1 Processor -- start 2024-09-17T04:25:54.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.385+0000 7fb381cbd640 1 -- start start 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0cffd0 0x7fb37c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 0x7fb37c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c15d2e0 con 0x7fb37c06d250 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c15d160 con 0x7fb37c0cffd0 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb381cbd640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c15d460 con 0x7fb37c1601c0 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45126/0 (socket says 172.21.15.63:45126) 2024-09-17T04:25:54.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 -- 172.21.15.63:0/745670334 learned_addr learned my addr 172.21.15.63:0/745670334 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37bfff640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 0x7fb37c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37affd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0cffd0 0x7fb37c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 -- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 msgr2=0x7fb37c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 0x7fb37c15ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 -- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0cffd0 msgr2=0x7fb37c15c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0cffd0 0x7fb37c15c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37b7fe640 1 -- 172.21.15.63:0/745670334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c148380 con 0x7fb37c06d250 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.386+0000 7fb37bfff640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 0x7fb37c15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb37b7fe640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c3c0 tx=0x7fb36c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c017070 con 0x7fb37c06d250 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb36c0035f0 con 0x7fb37c06d250 2024-09-17T04:25:54.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c15aa90 con 0x7fb37c06d250 2024-09-17T04:25:54.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c003a80 con 0x7fb37c06d250 2024-09-17T04:25:54.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.387+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c15b050 con 0x7fb37c06d250 2024-09-17T04:25:54.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.388+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c0cedf0 con 0x7fb37c06d250 2024-09-17T04:25:54.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.389+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb36c01a070 con 0x7fb37c06d250 2024-09-17T04:25:54.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.389+0000 7fb363fff640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 0x7fb36807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:54.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.389+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7fb36c09a000 con 0x7fb37c06d250 2024-09-17T04:25:54.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.389+0000 7fb37affd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 0x7fb36807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:54.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.390+0000 7fb37affd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 0x7fb36807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb37c15f7c0 tx=0x7fb370005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:54.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.394+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb37c0cedf0 con 0x7fb37c06d250 2024-09-17T04:25:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:54.581+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb37c15d9a0 con 0x7fb37c06d250 2024-09-17T04:25:55.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.250+0000 7fb363fff640 1 -- 172.21.15.63:0/745670334 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7fb37c06dba0 con 0x7fb37c06d250 2024-09-17T04:25:55.251 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 msgr2=0x7fb36807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 0x7fb36807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb37c15f7c0 tx=0x7fb370005f90 comp rx=0 tx=0).stop 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 msgr2=0x7fb37c147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c3c0 tx=0x7fb36c00c880 comp rx=0 tx=0).stop 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 shutdown_connections 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fb368078bc0 0x7fb36807b0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fb37c0cffd0 0x7fb37c15c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fb37c1601c0 0x7fb37c15ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 --2- 172.21.15.63:0/745670334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb37c06d250 0x7fb37c147e40 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c3c0 tx=0x7fb36c00c880 comp rx=0 tx=0).stop 2024-09-17T04:25:55.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 >> 172.21.15.63:0/745670334 conn(0x7fb37c0b26f0 msgr2=0x7fb37c159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:55.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 shutdown_connections 2024-09-17T04:25:55.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.255+0000 7fb381cbd640 1 -- 172.21.15.63:0/745670334 wait complete. 2024-09-17T04:25:55.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T04:25:55.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 -- 172.21.15.63:0/1341701642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 msgr2=0x7f3c440cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/1341701642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c440cf690 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3c440ba2a0 tx=0x7f3c3c02aae0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 -- 172.21.15.63:0/1341701642 shutdown_connections 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/1341701642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c440cf690 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/1341701642 >> v2:172.21.15.112:3300/0 conn(0x7f3c440d24a0 0x7f3c440d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 -- 172.21.15.63:0/1341701642 >> 172.21.15.63:0/1341701642 conn(0x7f3c440d45c0 msgr2=0x7f3c440d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 -- 172.21.15.63:0/1341701642 shutdown_connections 2024-09-17T04:25:55.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.395+0000 7f3c48cf9640 1 -- 172.21.15.63:0/1341701642 wait complete. 2024-09-17T04:25:55.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.397+0000 7f3c48cf9640 1 Processor -- start 2024-09-17T04:25:55.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.397+0000 7f3c48cf9640 1 -- start start 2024-09-17T04:25:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c440d24a0 0x7f3c44161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 0x7f3c441618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:55.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c440b2aa0 con 0x7f3c440cf280 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3c440b2920 con 0x7f3c4415eb70 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c48cf9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3c440b2c20 con 0x7f3c440d24a0 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c4259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c4259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45154/0 (socket says 172.21.15.63:45154) 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.398+0000 7f3c4259c640 1 -- 172.21.15.63:0/2488794598 learned_addr learned my addr 172.21.15.63:0/2488794598 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c42d9d640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 0x7f3c441618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c41d9b640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c440d24a0 0x7f3c44161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 -- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c440d24a0 msgr2=0x7f3c44161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c440d24a0 0x7f3c44161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 -- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 msgr2=0x7f3c441618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 0x7f3c441618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 -- 172.21.15.63:0/2488794598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c44154380 con 0x7f3c440cf280 2024-09-17T04:25:55.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c42d9d640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 0x7f3c441618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c4259c640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400c3c0 tx=0x7f3c3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34017070 con 0x7f3c440cf280 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c340035f0 con 0x7f3c440cf280 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c441538d0 con 0x7f3c440cf280 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34003a20 con 0x7f3c440cf280 2024-09-17T04:25:55.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.399+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c440c8b00 con 0x7f3c440cf280 2024-09-17T04:25:55.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.400+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c440b3130 con 0x7f3c440cf280 2024-09-17T04:25:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.401+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c3401a070 con 0x7f3c440cf280 2024-09-17T04:25:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.402+0000 7f3c3affd640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 0x7f3c2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.402+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f3c34099e60 con 0x7f3c440cf280 2024-09-17T04:25:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.402+0000 7f3c41d9b640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 0x7f3c2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:55.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.402+0000 7f3c41d9b640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 0x7f3c2407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c4408e050 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:55.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.406+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3c44154380 con 0x7f3c440cf280 2024-09-17T04:25:55.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:55.598+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c4415b620 con 0x7f3c440cf280 2024-09-17T04:25:56.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.252+0000 7f3c3affd640 1 -- 172.21.15.63:0/2488794598 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f3c34062490 con 0x7f3c440cf280 2024-09-17T04:25:56.253 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 msgr2=0x7f3c2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 0x7f3c2407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c4408e050 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 msgr2=0x7f3c44153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400c3c0 tx=0x7f3c3400c880 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 shutdown_connections 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3c24078b90 0x7f3c2407b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f3c4415eb70 0x7f3c441618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f3c440d24a0 0x7f3c44161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 --2- 172.21.15.63:0/2488794598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c440cf280 0x7f3c44153390 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 >> 172.21.15.63:0/2488794598 conn(0x7f3c440d45c0 msgr2=0x7f3c440b73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 shutdown_connections 2024-09-17T04:25:56.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.255+0000 7f3c48cf9640 1 -- 172.21.15.63:0/2488794598 wait complete. 2024-09-17T04:25:56.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 -- 172.21.15.63:0/2855256101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9860003a30 msgr2=0x7f9860003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 --2- 172.21.15.63:0/2855256101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9860003a30 0x7f9860003ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9870006fc0 tx=0x7f9860005830 comp rx=0 tx=0).stop 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987aa70640 1 -- 172.21.15.63:0/2855256101 reap_dead start 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 -- 172.21.15.63:0/2855256101 shutdown_connections 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 -- 172.21.15.63:0/2855256101 >> 172.21.15.63:0/2855256101 conn(0x7f987409d7f0 msgr2=0x7f98740d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 -- 172.21.15.63:0/2855256101 shutdown_connections 2024-09-17T04:25:56.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.398+0000 7f987c4d3640 1 -- 172.21.15.63:0/2855256101 wait complete. 2024-09-17T04:25:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.401+0000 7f987c4d3640 1 Processor -- start 2024-09-17T04:25:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.401+0000 7f987c4d3640 1 -- start start 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9860003a30 0x7f98740ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98740c7440 0x7f98741fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f987406f340 con 0x7f98741615d0 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f987406f1c0 con 0x7f9860003a30 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987c4d3640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f987406f4c0 con 0x7f98740c7440 2024-09-17T04:25:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f9879a6e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98740c7440 0x7f98741fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987a26f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9860003a30 0x7f98740ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45174/0 (socket says 172.21.15.63:45174) 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 -- 172.21.15.63:0/1217547700 learned_addr learned my addr 172.21.15.63:0/1217547700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 -- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98740c7440 msgr2=0x7f98741fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98740c7440 0x7f98741fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 -- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9860003a30 msgr2=0x7f98740ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9860003a30 0x7f98740ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.403+0000 7f987aa70640 1 -- 172.21.15.63:0/1217547700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9874161f20 con 0x7f98741615d0 2024-09-17T04:25:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f987aa70640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f98740cb530 tx=0x7f986c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c004b20 con 0x7f98741615d0 2024-09-17T04:25:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f986c004cc0 con 0x7f98741615d0 2024-09-17T04:25:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98740ca360 con 0x7f98741615d0 2024-09-17T04:25:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003bd0 con 0x7f98741615d0 2024-09-17T04:25:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.404+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98741fd3d0 con 0x7f98741615d0 2024-09-17T04:25:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.406+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98740c8ef0 con 0x7f98741615d0 2024-09-17T04:25:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.406+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f986c004030 con 0x7f98741615d0 2024-09-17T04:25:56.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.407+0000 7f986affd640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 0x7f985807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.407+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f986c09ada0 con 0x7f98741615d0 2024-09-17T04:25:56.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.407+0000 7f987a26f640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 0x7f985807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.408+0000 7f987a26f640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 0x7f985807b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9870033000 tx=0x7f9870001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:56.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.412+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9874161f20 con 0x7f98741615d0 2024-09-17T04:25:56.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.599+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f98741fd1c0 con 0x7f98741615d0 2024-09-17T04:25:56.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.603+0000 7f986affd640 1 -- 172.21.15.63:0/1217547700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f986c062e90 con 0x7f98741615d0 2024-09-17T04:25:56.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 msgr2=0x7f985807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 0x7f985807b0d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9870033000 tx=0x7f9870001110 comp rx=0 tx=0).stop 2024-09-17T04:25:56.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 msgr2=0x7f98741619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f98740cb530 tx=0x7f986c00f3c0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 shutdown_connections 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f9858078bc0 0x7f985807b0d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98741615d0 0x7f98741619e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f98740c7440 0x7f98741fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 --2- 172.21.15.63:0/1217547700 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f9860003a30 0x7f98740ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 >> 172.21.15.63:0/1217547700 conn(0x7f987409d7f0 msgr2=0x7f98740d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:56.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 shutdown_connections 2024-09-17T04:25:56.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.605+0000 7f987c4d3640 1 -- 172.21.15.63:0/1217547700 wait complete. 2024-09-17T04:25:56.618 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-09-17T04:25:56.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 -- 172.21.15.63:0/3176922788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80b9be0 msgr2=0x7f77a80d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/3176922788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80b9be0 0x7f77a80d4510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f779c009830 tx=0x7f779c02a510 comp rx=0 tx=0).stop 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 -- 172.21.15.63:0/3176922788 shutdown_connections 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/3176922788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80b9be0 0x7f77a80d4510 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 -- 172.21.15.63:0/3176922788 >> 172.21.15.63:0/3176922788 conn(0x7f77a808bfc0 msgr2=0x7f77a809d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 -- 172.21.15.63:0/3176922788 shutdown_connections 2024-09-17T04:25:56.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.734+0000 7f77ae0f9640 1 -- 172.21.15.63:0/3176922788 wait complete. 2024-09-17T04:25:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.736+0000 7f77ae0f9640 1 Processor -- start 2024-09-17T04:25:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.736+0000 7f77ae0f9640 1 -- start start 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a80b9be0 0x7f77a815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a80d4a50 0x7f77a80ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80b4c60 con 0x7f77a80d0ce0 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80b4ae0 con 0x7f77a80b9be0 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f77a80b4de0 con 0x7f77a80d4a50 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45186/0 (socket says 172.21.15.63:45186) 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 -- 172.21.15.63:0/1703087573 learned_addr learned my addr 172.21.15.63:0/1703087573 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a77fe640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a80b9be0 0x7f77a815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a7fff640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a80d4a50 0x7f77a80ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 -- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a80d4a50 msgr2=0x7f77a80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a80d4a50 0x7f77a80ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 -- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a80b9be0 msgr2=0x7f77a815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a80b9be0 0x7f77a815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 -- 172.21.15.63:0/1703087573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a81f6f60 con 0x7f77a80d0ce0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77a6ffd640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f779c000c00 tx=0x7f779c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c031d60 con 0x7f77a80d0ce0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f779c0330d0 con 0x7f77a80d0ce0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a81f9780 con 0x7f77a80d0ce0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c033520 con 0x7f77a80d0ce0 2024-09-17T04:25:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.738+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a81f9d40 con 0x7f77a80d0ce0 2024-09-17T04:25:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.740+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a80b5a10 con 0x7f77a80d0ce0 2024-09-17T04:25:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.740+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f779c0035f0 con 0x7f77a80d0ce0 2024-09-17T04:25:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.741+0000 7f778ffff640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 0x7f779407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.741+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f779c0bbf80 con 0x7f77a80d0ce0 2024-09-17T04:25:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.741+0000 7f77a77fe640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 0x7f779407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:56.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.742+0000 7f77a77fe640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 0x7f779407b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77980015e0 tx=0x7f7798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:56.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:56.746+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77a80b5a10 con 0x7f77a80d0ce0 2024-09-17T04:25:57.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.000+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f77a80d4510 con 0x7f77a80d0ce0 2024-09-17T04:25:57.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.257+0000 7f778ffff640 1 -- 172.21.15.63:0/1703087573 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v121) ==== 120+0+0 (secure 0 0 0) 0x7f779c08be20 con 0x7f77a80d0ce0 2024-09-17T04:25:57.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 msgr2=0x7f779407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:57.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 0x7f779407b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77980015e0 tx=0x7f7798009040 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 msgr2=0x7f77a815e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f779c000c00 tx=0x7f779c033d60 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 shutdown_connections 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7794078b90 0x7f779407b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f77a80d4a50 0x7f77a80ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77a80d0ce0 0x7f77a815e220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 --2- 172.21.15.63:0/1703087573 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f77a80b9be0 0x7f77a815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.259+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 >> 172.21.15.63:0/1703087573 conn(0x7f77a808bfc0 msgr2=0x7f77a806f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.260+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 shutdown_connections 2024-09-17T04:25:57.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:57.260+0000 7f77ae0f9640 1 -- 172.21.15.63:0/1703087573 wait complete. 2024-09-17T04:25:57.272 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ok 2024-09-17T04:25:57.272 INFO:tasks.cephfs_test_runner: 2024-09-17T04:25:57.272 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T04:25:57.272 INFO:tasks.cephfs_test_runner:Ran 1 test in 129.095s 2024-09-17T04:25:57.273 INFO:tasks.cephfs_test_runner: 2024-09-17T04:25:57.273 INFO:tasks.cephfs_test_runner:OK 2024-09-17T04:25:57.273 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T04:25:57.282 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T04:25:57.289 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T04:25:57.290 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:25:57.290 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:57.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=602 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T04:25:57.306 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-17T04:25:57.306 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:57.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=602 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T04:25:57.362 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:25:57.362 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:57.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T04:25:57.382 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-17T04:25:57.382 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T04:25:57.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056009,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14222 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T04:25:57.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.440 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:25:57.457 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T04:25:57.457 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T04:25:57.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.457 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T04:25:57.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T04:25:57.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T04:25:57.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.685 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-17T04:25:57.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-17T04:25:57.770 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-17T04:25:57.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:25:57.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.772 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:25:57.791 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T04:25:57.791 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T04:25:57.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.792 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T04:25:57.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T04:25:57.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:57.932 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-17T04:25:58.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:58.029 DEBUG:teuthology.orchestra.run.smithi112:> ip netns list 2024-09-17T04:25:58.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T04:25:58.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo ip link delete ceph-brx 2024-09-17T04:25:58.114 INFO:teuthology.orchestra.run.smithi112.stderr:Cannot find device "ceph-brx" 2024-09-17T04:25:58.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:25:58.115 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T04:25:58.124 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T04:25:58.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:25:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 -- 172.21.15.63:0/1796695042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500706b0 msgr2=0x7f31500735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1796695042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500706b0 0x7f31500735b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f31500c71a0 tx=0x7f314802aac0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 -- 172.21.15.63:0/1796695042 shutdown_connections 2024-09-17T04:25:58.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1796695042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500706b0 0x7f31500735b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1796695042 >> v2:172.21.15.112:3300/0 conn(0x7f31500ca800 0x7f31500cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 -- 172.21.15.63:0/1796695042 >> 172.21.15.63:0/1796695042 conn(0x7f31500b1cb0 msgr2=0x7f31500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 -- 172.21.15.63:0/1796695042 shutdown_connections 2024-09-17T04:25:58.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.242+0000 7f3154c5c640 1 -- 172.21.15.63:0/1796695042 wait complete. 2024-09-17T04:25:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.244+0000 7f3154c5c640 1 Processor -- start 2024-09-17T04:25:58.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.244+0000 7f3154c5c640 1 -- start start 2024-09-17T04:25:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31500ca800 0x7f315006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315015dbe0 0x7f31501f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3150073ef0 con 0x7f31500cad30 2024-09-17T04:25:58.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f3150073d70 con 0x7f315015dbe0 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.245+0000 7f3154c5c640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f3150074070 con 0x7f31500ca800 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45206/0 (socket says 172.21.15.63:45206) 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 -- 172.21.15.63:0/1257175828 learned_addr learned my addr 172.21.15.63:0/1257175828 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314ed9d640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315015dbe0 0x7f31501f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314e59c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31500ca800 0x7f315006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 -- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31500ca800 msgr2=0x7f315006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31500ca800 0x7f315006f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 -- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315015dbe0 msgr2=0x7f31501f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315015dbe0 0x7f31501f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 -- 172.21.15.63:0/1257175828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315015ed40 con 0x7f31500cad30 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f314dd9b640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f314400c3a0 tx=0x7f314400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144017070 con 0x7f31500cad30 2024-09-17T04:25:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31440053c0 con 0x7f31500cad30 2024-09-17T04:25:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315006efc0 con 0x7f31500cad30 2024-09-17T04:25:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144003850 con 0x7f31500cad30 2024-09-17T04:25:58.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.246+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315015e780 con 0x7f31500cad30 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.247+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150074600 con 0x7f31500cad30 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.248+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f314401a070 con 0x7f31500cad30 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.249+0000 7f313effd640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 0x7f313007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.249+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f3144099cb0 con 0x7f31500cad30 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.249+0000 7f314e59c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 0x7f313007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.249+0000 7f314e59c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 0x7f313007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31500cb250 tx=0x7f3140009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.253+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3144061ec0 con 0x7f31500cad30 2024-09-17T04:25:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.435+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f315015d860 con 0x7f3130078b90 2024-09-17T04:25:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.436+0000 7f313effd640 1 -- 172.21.15.63:0/1257175828 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7f315015d860 con 0x7f3130078b90 2024-09-17T04:25:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 msgr2=0x7f313007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 0x7f313007b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31500cb250 tx=0x7f3140009060 comp rx=0 tx=0).stop 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 msgr2=0x7f31500c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f314400c3a0 tx=0x7f314400c860 comp rx=0 tx=0).stop 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 shutdown_connections 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3130078b90 0x7f313007b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f315015dbe0 0x7f31501f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31500cad30 0x7f31500c9920 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 --2- 172.21.15.63:0/1257175828 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31500ca800 0x7f315006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 >> 172.21.15.63:0/1257175828 conn(0x7f31500b1cb0 msgr2=0x7f31500b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:58.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 shutdown_connections 2024-09-17T04:25:58.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.438+0000 7f3154c5c640 1 -- 172.21.15.63:0/1257175828 wait complete. 2024-09-17T04:25:58.450 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-17T04:25:56.440895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229712,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745008,"statfs":{"total":773094113280,"available":772858888192,"internally_reserved":0,"allocated":5316608,"data_stored":3499970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-575348,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-96,"num_write_kb":-609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001967"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304219+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:24:07.304219+0000","last_peered":"2024-09-17T04:24:07.304219+0000","last_clean":"2024-09-17T04:24:07.304219+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:24:07.304219+0000","last_undegraded":"2024-09-17T04:24:07.304219+0000","last_fullsized":"2024-09-17T04:24:07.304219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":739994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":732388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":368640,"data_stored":141560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":970752,"data_stored":739994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:25:58.451 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 -- 172.21.15.63:0/753508098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc0b4530 msgr2=0x7f36bc0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 --2- 172.21.15.63:0/753508098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc0b4530 0x7f36bc0d0bf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f36b4005fd0 tx=0x7f36b402aa30 comp rx=0 tx=0).stop 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 -- 172.21.15.63:0/753508098 shutdown_connections 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 --2- 172.21.15.63:0/753508098 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc0b4530 0x7f36bc0d0bf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 --2- 172.21.15.63:0/753508098 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 0x7f36bc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 -- 172.21.15.63:0/753508098 >> 172.21.15.63:0/753508098 conn(0x7f36bc0cee20 msgr2=0x7f36bc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:58.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 -- 172.21.15.63:0/753508098 shutdown_connections 2024-09-17T04:25:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.567+0000 7f36c4456640 1 -- 172.21.15.63:0/753508098 wait complete. 2024-09-17T04:25:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.569+0000 7f36c4456640 1 Processor -- start 2024-09-17T04:25:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.569+0000 7f36c4456640 1 -- start start 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 0x7f36bc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 0x7f36bc1f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d17d0 con 0x7f36bc160c90 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d1650 con 0x7f36bc15a600 2024-09-17T04:25:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c4456640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0d1950 con 0x7f36bc0cff70 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c19f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c19f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45222/0 (socket says 172.21.15.63:45222) 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c19f1640 1 -- 172.21.15.63:0/1357692301 learned_addr learned my addr 172.21.15.63:0/1357692301 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c29f3640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 0x7f36bc1f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.570+0000 7f36c21f2640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 0x7f36bc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 -- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 msgr2=0x7f36bc155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 0x7f36bc155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 -- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 msgr2=0x7f36bc1f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 0x7f36bc1f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 -- 172.21.15.63:0/1357692301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc15aa10 con 0x7f36bc160c90 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c29f3640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 0x7f36bc1f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c19f1640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c3f0 tx=0x7f36ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac017070 con 0x7f36bc160c90 2024-09-17T04:25:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36ac0053c0 con 0x7f36bc160c90 2024-09-17T04:25:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc1f62a0 con 0x7f36bc160c90 2024-09-17T04:25:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003870 con 0x7f36bc160c90 2024-09-17T04:25:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.571+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1f54e0 con 0x7f36bc160c90 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.572+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0d1e00 con 0x7f36bc160c90 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.573+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36ac01a070 con 0x7f36bc160c90 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.574+0000 7f36b2ffd640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 0x7f36a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.574+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f36ac099c40 con 0x7f36bc160c90 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.574+0000 7f36c21f2640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 0x7f36a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.574+0000 7f36c21f2640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 0x7f36a007b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ac0 tx=0x7f36b8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.578+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36bc15aa10 con 0x7f36bc160c90 2024-09-17T04:25:58.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.761+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36bc155fd0 con 0x7f36a0078b90 2024-09-17T04:25:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.762+0000 7f36b2ffd640 1 -- 172.21.15.63:0/1357692301 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7f36bc155fd0 con 0x7f36a0078b90 2024-09-17T04:25:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:25:58.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 msgr2=0x7f36a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 0x7f36a007b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009ac0 tx=0x7f36b8005f90 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 msgr2=0x7f36bc15a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00c3f0 tx=0x7f36ac00c7f0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 shutdown_connections 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f36a0078b90 0x7f36a007b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f36bc15a600 0x7f36bc1f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f36bc160c90 0x7f36bc15a0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 --2- 172.21.15.63:0/1357692301 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f36bc0cff70 0x7f36bc155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 >> 172.21.15.63:0/1357692301 conn(0x7f36bc0cee20 msgr2=0x7f36bc1e8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.764+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 shutdown_connections 2024-09-17T04:25:58.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.765+0000 7f36c4456640 1 -- 172.21.15.63:0/1357692301 wait complete. 2024-09-17T04:25:58.777 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-17T04:25:58.441278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":229192,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745528,"statfs":{"total":773094113280,"available":772859420672,"internally_reserved":0,"allocated":4771840,"data_stored":2925592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-575348,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-99,"num_write_kb":-611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001698"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304219+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:24:07.304219+0000","last_peered":"2024-09-17T04:24:07.304219+0000","last_clean":"2024-09-17T04:24:07.304219+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:24:07.304219+0000","last_undegraded":"2024-09-17T04:24:07.304219+0000","last_fullsized":"2024-09-17T04:24:07.304219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":739994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":732388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:25:58.777 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T04:25:58.777 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 -- 172.21.15.63:0/1379514707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c81620e0 msgr2=0x7f72c80b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 --2- 172.21.15.63:0/1379514707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c81620e0 0x7f72c80b5fa0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005fd0 tx=0x7f72b802a5d0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 -- 172.21.15.63:0/1379514707 shutdown_connections 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 --2- 172.21.15.63:0/1379514707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c81620e0 0x7f72c80b5fa0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 --2- 172.21.15.63:0/1379514707 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 0x7f72c80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 -- 172.21.15.63:0/1379514707 >> 172.21.15.63:0/1379514707 conn(0x7f72c809d870 msgr2=0x7f72c80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 -- 172.21.15.63:0/1379514707 shutdown_connections 2024-09-17T04:25:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.893+0000 7f72d044d640 1 -- 172.21.15.63:0/1379514707 wait complete. 2024-09-17T04:25:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.895+0000 7f72d044d640 1 Processor -- start 2024-09-17T04:25:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.895+0000 7f72d044d640 1 -- start start 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 0x7f72c81f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 0x7f72c80cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80d3970 con 0x7f72c80b64e0 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80d37f0 con 0x7f72c81620e0 2024-09-17T04:25:58.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72d044d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f72c806e5b0 con 0x7f72c80b9d00 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45232/0 (socket says 172.21.15.63:45232) 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 -- 172.21.15.63:0/3935591653 learned_addr learned my addr 172.21.15.63:0/3935591653 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72cd9e8640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 0x7f72c81f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce9ea640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 0x7f72c80cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 -- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 msgr2=0x7f72c81f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 0x7f72c81f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 -- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 msgr2=0x7f72c80cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 0x7f72c80cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce1e9640 1 -- 172.21.15.63:0/3935591653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c80cd200 con 0x7f72c80b64e0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.896+0000 7f72ce9ea640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 0x7f72c80cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72ce1e9640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72c400d700 tx=0x7f72c400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4017070 con 0x7f72c80b64e0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72c4009d20 con 0x7f72c80b64e0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c80cb800 con 0x7f72c80b64e0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40106c0 con 0x7f72c80b64e0 2024-09-17T04:25:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.897+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c80b15e0 con 0x7f72c80b64e0 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.898+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c806eb60 con 0x7f72c80b64e0 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.899+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72c401a070 con 0x7f72c80b64e0 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.899+0000 7f72beffd640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 0x7f72ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.900+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f72c409ab60 con 0x7f72c80b64e0 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.900+0000 7f72cd9e8640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 0x7f72ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.900+0000 7f72cd9e8640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 0x7f72ac07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72b8033000 tx=0x7f72b8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:58.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:58.904+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f72c4062c50 con 0x7f72c80b64e0 2024-09-17T04:25:59.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.085+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72c80b1880 con 0x7f72ac078b90 2024-09-17T04:25:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.086+0000 7f72beffd640 1 -- 172.21.15.63:0/3935591653 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13464 (secure 0 0 0) 0x7f72c80b1880 con 0x7f72ac078b90 2024-09-17T04:25:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:59.087 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:25:59.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 msgr2=0x7f72ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 0x7f72ac07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72b8033000 tx=0x7f72b8004730 comp rx=0 tx=0).stop 2024-09-17T04:25:59.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 msgr2=0x7f72c81f9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f72c400d700 tx=0x7f72c400dbc0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 shutdown_connections 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f72ac078b90 0x7f72ac07b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f72c81620e0 0x7f72c80cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f72c80b9d00 0x7f72c81f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 --2- 172.21.15.63:0/3935591653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f72c80b64e0 0x7f72c81f9530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 >> 172.21.15.63:0/3935591653 conn(0x7f72c809d870 msgr2=0x7f72c8160a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 shutdown_connections 2024-09-17T04:25:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.089+0000 7f72d044d640 1 -- 172.21.15.63:0/3935591653 wait complete. 2024-09-17T04:25:59.101 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-17T04:25:58.441278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":229192,"kb_used_data":4660,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745528,"statfs":{"total":773094113280,"available":772859420672,"internally_reserved":0,"allocated":4771840,"data_stored":2925592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-575348,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-99,"num_write_kb":-611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001698"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T04:24:07.304219+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:24:07.304219+0000","last_peered":"2024-09-17T04:24:07.304219+0000","last_clean":"2024-09-17T04:24:07.304219+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:24:07.304219+0000","last_undegraded":"2024-09-17T04:24:07.304219+0000","last_fullsized":"2024-09-17T04:24:07.304219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":726397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":970752,"data_stored":739994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":136009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":732388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:25:59.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.219+0000 7f185c589640 1 -- 172.21.15.63:0/972868653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 msgr2=0x7f18540cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.219+0000 7f185c589640 1 --2- 172.21.15.63:0/972868653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f18540cef50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f184c005fd0 tx=0x7f184c02a820 comp rx=0 tx=0).stop 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 -- 172.21.15.63:0/972868653 shutdown_connections 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 --2- 172.21.15.63:0/972868653 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f18540cef50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 --2- 172.21.15.63:0/972868653 >> v2:172.21.15.112:3300/0 conn(0x7f185406e170 0x7f18540b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 -- 172.21.15.63:0/972868653 >> 172.21.15.63:0/972868653 conn(0x7f185408bfc0 msgr2=0x7f185409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 -- 172.21.15.63:0/972868653 shutdown_connections 2024-09-17T04:25:59.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.220+0000 7f185c589640 1 -- 172.21.15.63:0/972868653 wait complete. 2024-09-17T04:25:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.222+0000 7f185c589640 1 Processor -- start 2024-09-17T04:25:59.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.222+0000 7f185c589640 1 -- start start 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f185415f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854153a20 0x7f1854153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18540d0e60 con 0x7f185406f4b0 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f18540d0ce0 con 0x7f1854153a20 2024-09-17T04:25:59.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185c589640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f18540d0fe0 con 0x7f18540ceb40 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45246/0 (socket says 172.21.15.63:45246) 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 -- 172.21.15.63:0/484228294 learned_addr learned my addr 172.21.15.63:0/484228294 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f1859b24640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f185415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185ab26640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854153a20 0x7f1854153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 -- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 msgr2=0x7f185415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f185415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 -- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854153a20 msgr2=0x7f1854153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854153a20 0x7f1854153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.223+0000 7f185a325640 1 -- 172.21.15.63:0/484228294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1854154370 con 0x7f185406f4b0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f1859b24640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f185415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f185a325640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f185000e790 tx=0x7f185000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000eea0 con 0x7f185406f4b0 2024-09-17T04:25:59.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f185000cdb0 con 0x7f185406f4b0 2024-09-17T04:25:59.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18541516a0 con 0x7f185406f4b0 2024-09-17T04:25:59.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850010690 con 0x7f185406f4b0 2024-09-17T04:25:59.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.224+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18540cca20 con 0x7f185406f4b0 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.226+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18540d1570 con 0x7f185406f4b0 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.226+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1850010830 con 0x7f185406f4b0 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.226+0000 7f184affd640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 0x7f183807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.227+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f185009b3d0 con 0x7f185406f4b0 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.227+0000 7f1859b24640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 0x7f183807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:25:59.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.227+0000 7f1859b24640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 0x7f183807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18540b36c0 tx=0x7f1844007f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:25:59.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.231+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18500635e0 con 0x7f185406f4b0 2024-09-17T04:25:59.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.424+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18540b6800 con 0x7f185406f4b0 2024-09-17T04:25:59.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.425+0000 7f184affd640 1 -- 172.21.15.63:0/484228294 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13008 (secure 0 0 0) 0x7f1850068010 con 0x7f185406f4b0 2024-09-17T04:25:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:25:59.426 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":35,"fsid":"2184e050-2c9d-47fc-8e14-c53eccd8cf79","created":"2024-09-17T04:23:00.006545+0000","modified":"2024-09-17T04:25:56.252549+0000","last_up_change":"2024-09-17T04:23:13.213009+0000","last_in_change":"2024-09-17T04:23:03.633555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T04:23:12.414663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca8b7aa0-e7f2-4606-878d-c0fdd56251ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6817","nonce":3094040148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6819","nonce":3094040148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6823","nonce":3094040148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3094040148},{"type":"v1","addr":"172.21.15.63:6821","nonce":3094040148}]},"public_addr":"172.21.15.63:6817/3094040148","cluster_addr":"172.21.15.63:6819/3094040148","heartbeat_back_addr":"172.21.15.63:6823/3094040148","heartbeat_front_addr":"172.21.15.63:6821/3094040148","state":["exists","up"]},{"osd":1,"uuid":"3092af67-cdec-4fb5-ab0a-4df47973e964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6801","nonce":3223774587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6803","nonce":3223774587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6807","nonce":3223774587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":3223774587},{"type":"v1","addr":"172.21.15.63:6805","nonce":3223774587}]},"public_addr":"172.21.15.63:6801/3223774587","cluster_addr":"172.21.15.63:6803/3223774587","heartbeat_back_addr":"172.21.15.63:6807/3223774587","heartbeat_front_addr":"172.21.15.63:6805/3223774587","state":["exists","up"]},{"osd":2,"uuid":"30ad4e4b-a414-4cc1-8cb1-d7413b10bee1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6825","nonce":59655443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6827","nonce":59655443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6831","nonce":59655443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":59655443},{"type":"v1","addr":"172.21.15.63:6829","nonce":59655443}]},"public_addr":"172.21.15.63:6825/59655443","cluster_addr":"172.21.15.63:6827/59655443","heartbeat_back_addr":"172.21.15.63:6831/59655443","heartbeat_front_addr":"172.21.15.63:6829/59655443","state":["exists","up"]},{"osd":3,"uuid":"b8d95ef1-7f46-4a8f-904b-f34be2c51754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6809","nonce":126176733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6811","nonce":126176733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6815","nonce":126176733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":126176733},{"type":"v1","addr":"172.21.15.63:6813","nonce":126176733}]},"public_addr":"172.21.15.63:6809/126176733","cluster_addr":"172.21.15.63:6811/126176733","heartbeat_back_addr":"172.21.15.63:6815/126176733","heartbeat_front_addr":"172.21.15.63:6813/126176733","state":["exists","up"]},{"osd":4,"uuid":"5d4d52cc-a843-4963-b45f-0bd4c63aa345","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6827","nonce":4200339545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6829","nonce":4200339545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6833","nonce":4200339545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":4200339545},{"type":"v1","addr":"172.21.15.112:6831","nonce":4200339545}]},"public_addr":"172.21.15.112:6827/4200339545","cluster_addr":"172.21.15.112:6829/4200339545","heartbeat_back_addr":"172.21.15.112:6833/4200339545","heartbeat_front_addr":"172.21.15.112:6831/4200339545","state":["exists","up"]},{"osd":5,"uuid":"6c15124d-f37a-43d3-84b4-a3c3e666fdff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6803","nonce":3916391572}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6805","nonce":3916391572}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6809","nonce":3916391572}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3916391572},{"type":"v1","addr":"172.21.15.112:6807","nonce":3916391572}]},"public_addr":"172.21.15.112:6803/3916391572","cluster_addr":"172.21.15.112:6805/3916391572","heartbeat_back_addr":"172.21.15.112:6809/3916391572","heartbeat_front_addr":"172.21.15.112:6807/3916391572","state":["exists","up"]},{"osd":6,"uuid":"7a1c0721-b259-464b-b691-8b483f8dc9c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6811","nonce":3726125666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6813","nonce":3726125666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6817","nonce":3726125666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3726125666},{"type":"v1","addr":"172.21.15.112:6815","nonce":3726125666}]},"public_addr":"172.21.15.112:6811/3726125666","cluster_addr":"172.21.15.112:6813/3726125666","heartbeat_back_addr":"172.21.15.112:6817/3726125666","heartbeat_front_addr":"172.21.15.112:6815/3726125666","state":["exists","up"]},{"osd":7,"uuid":"bfd57500-4bb7-456a-a9d1-5b51dd9827a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6819","nonce":843462089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6821","nonce":843462089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6825","nonce":843462089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":843462089},{"type":"v1","addr":"172.21.15.112:6823","nonce":843462089}]},"public_addr":"172.21.15.112:6819/843462089","cluster_addr":"172.21.15.112:6821/843462089","heartbeat_back_addr":"172.21.15.112:6825/843462089","heartbeat_front_addr":"172.21.15.112:6823/843462089","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.499093+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.892648+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.668411+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.484915+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.359698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:09.420922+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.174077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T04:23:10.409958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6834/1995424855":"2024-09-18T04:25:53.240912+0000","172.21.15.63:6832/1995424855":"2024-09-18T04:25:53.240912+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T04:25:59.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 msgr2=0x7f183807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 0x7f183807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18540b36c0 tx=0x7f1844007f70 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 msgr2=0x7f18541f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f185000e790 tx=0x7f185000ec50 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 shutdown_connections 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f1838078b90 0x7f183807b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f1854153a20 0x7f1854153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f18540ceb40 0x7f185415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 --2- 172.21.15.63:0/484228294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f185406f4b0 0x7f18541f62f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 >> 172.21.15.63:0/484228294 conn(0x7f185408bfc0 msgr2=0x7f18540b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 shutdown_connections 2024-09-17T04:25:59.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:25:59.427+0000 7f185c589640 1 -- 172.21.15.63:0/484228294 wait complete. 2024-09-17T04:26:00.440 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T04:26:00.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:00.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 -- 172.21.15.63:0/3460845266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec406e0f0 msgr2=0x7faec406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 --2- 172.21.15.63:0/3460845266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec406e0f0 0x7faec406f3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009830 tx=0x7faeb402a480 comp rx=0 tx=0).stop 2024-09-17T04:26:00.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 -- 172.21.15.63:0/3460845266 shutdown_connections 2024-09-17T04:26:00.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 --2- 172.21.15.63:0/3460845266 >> v2:172.21.15.112:3300/0 conn(0x7faec40d0e20 0x7faec40d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 --2- 172.21.15.63:0/3460845266 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec406e0f0 0x7faec406f3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 -- 172.21.15.63:0/3460845266 >> 172.21.15.63:0/3460845266 conn(0x7faec409d800 msgr2=0x7faec408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:00.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 -- 172.21.15.63:0/3460845266 shutdown_connections 2024-09-17T04:26:00.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.563+0000 7faeca60a640 1 -- 172.21.15.63:0/3460845266 wait complete. 2024-09-17T04:26:00.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.565+0000 7faeca60a640 1 Processor -- start 2024-09-17T04:26:00.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.565+0000 7faeca60a640 1 -- start start 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec406e0f0 0x7faec40b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec40b5f60 0x7faec40a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 0x7faec40a2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faec40b6a80 con 0x7faec40d0e20 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7faec40d3e90 con 0x7faec406e0f0 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faeca60a640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7faec40b6c00 con 0x7faec40b5f60 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 0x7faec40a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 0x7faec40a2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33398/0 (socket says 172.21.15.63:33398) 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 -- 172.21.15.63:0/4233607094 learned_addr learned my addr 172.21.15.63:0/4233607094 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec3fff640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec406e0f0 0x7faec40b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec37fe640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec40b5f60 0x7faec40a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 -- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec40b5f60 msgr2=0x7faec40a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec40b5f60 0x7faec40a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 -- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec406e0f0 msgr2=0x7faec40b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7faec406e0f0 0x7faec40b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec40b93d0 con 0x7faec40d0e20 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec37fe640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7faec40b5f60 0x7faec40a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.567+0000 7faec8ba7640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 0x7faec40a2010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ca70 tx=0x7faebc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.568+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc016020 con 0x7faec40d0e20 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.568+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faebc00ac60 con 0x7faec40d0e20 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.568+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc012680 con 0x7faec40d0e20 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.568+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec40b8e10 con 0x7faec40d0e20 2024-09-17T04:26:00.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.568+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41d2740 con 0x7faec40d0e20 2024-09-17T04:26:00.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.569+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faec406f3f0 con 0x7faec40d0e20 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faebc019020 con 0x7faec40d0e20 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faeb0078b90 0x7faeb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7faebc09b700 con 0x7faec40d0e20 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec3fff640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faeb0078b90 0x7faeb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7faeb007eaa0 0x7faeb0080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faebc010e50 con 0x7faeb007eaa0 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faebc09bb90 con 0x7faec40d0e20 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.570+0000 7faec37fe640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7faeb007eaa0 0x7faeb0080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.571+0000 7faec37fe640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7faeb007eaa0 0x7faeb0080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:00.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.571+0000 7faec3fff640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faeb0078b90 0x7faeb007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faeb4034000 tx=0x7faeb4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:00.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.571+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== osd.0 v2:172.21.15.63:6816/3094040148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faebc010e50 con 0x7faeb007eaa0 2024-09-17T04:26:00.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.584+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 --> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faec40ce430 con 0x7faeb007eaa0 2024-09-17T04:26:00.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.584+0000 7faec0ff9640 1 -- 172.21.15.63:0/4233607094 <== osd.0 v2:172.21.15.63:6816/3094040148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faec40ce430 con 0x7faeb007eaa0 2024-09-17T04:26:00.585 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:00.585 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:00.586 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:00.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7faeb007eaa0 msgr2=0x7faeb0080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:6816/3094040148,v1:172.21.15.63:6817/3094040148] conn(0x7faeb007eaa0 0x7faeb0080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faeb0078b90 msgr2=0x7faeb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7faeb0078b90 0x7faeb007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faeb4034000 tx=0x7faeb4004730 comp rx=0 tx=0).stop 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 msgr2=0x7faec40a2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 --2- 172.21.15.63:0/4233607094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faec40d0e20 0x7faec40a2010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faebc00ca70 tx=0x7faebc00cf30 comp rx=0 tx=0).stop 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faec8ba7640 1 -- 172.21.15.63:0/4233607094 reap_dead start 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 shutdown_connections 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 >> 172.21.15.63:0/4233607094 conn(0x7faec409d800 msgr2=0x7faec41e6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 shutdown_connections 2024-09-17T04:26:00.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.585+0000 7faeca60a640 1 -- 172.21.15.63:0/4233607094 wait complete. 2024-09-17T04:26:00.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T04:26:00.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 -- 172.21.15.63:0/433890247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 msgr2=0x7f58700d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 --2- 172.21.15.63:0/433890247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700d4d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5868009820 tx=0x7f586802a3f0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 -- 172.21.15.63:0/433890247 shutdown_connections 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 --2- 172.21.15.63:0/433890247 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700b66b0 0x7f587006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 --2- 172.21.15.63:0/433890247 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700d4d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 -- 172.21.15.63:0/433890247 >> 172.21.15.63:0/433890247 conn(0x7f587009d7f0 msgr2=0x7f58700d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 -- 172.21.15.63:0/433890247 shutdown_connections 2024-09-17T04:26:00.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.713+0000 7f5876cb2640 1 -- 172.21.15.63:0/433890247 wait complete. 2024-09-17T04:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.715+0000 7f5876cb2640 1 Processor -- start 2024-09-17T04:26:00.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.715+0000 7f5876cb2640 1 -- start start 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700cf540 0x7f58700ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f587006f630 con 0x7f587015e610 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f587006f4b0 con 0x7f58700b9b60 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5876cb2640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f587006f7b0 con 0x7f58700cf540 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33406/0 (socket says 172.21.15.63:33406) 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 -- 172.21.15.63:0/3372488983 learned_addr learned my addr 172.21.15.63:0/3372488983 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f586ffff640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700cf540 0x7f58700ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f5874a4e640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 -- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700cf540 msgr2=0x7f58700ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700cf540 0x7f58700ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 -- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 msgr2=0x7f58700cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.717+0000 7f587524f640 1 -- 172.21.15.63:0/3372488983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58700c8de0 con 0x7f587015e610 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f587524f640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f585800e740 tx=0x7f585800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585800ccc0 con 0x7f587015e610 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f585800ce80 con 0x7f587015e610 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58700c90c0 con 0x7f587015e610 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858005280 con 0x7f587015e610 2024-09-17T04:26:00.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.718+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58700c9680 con 0x7f587015e610 2024-09-17T04:26:00.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.719+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58700cc250 con 0x7f587015e610 2024-09-17T04:26:00.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.720+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5858005420 con 0x7f587015e610 2024-09-17T04:26:00.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.720+0000 7f586d7fa640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 0x7f585007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:00.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.720+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f585809b160 con 0x7f587015e610 2024-09-17T04:26:00.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.720+0000 7f5874a4e640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 0x7f585007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:00.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.721+0000 7f5874a4e640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 0x7f585007b0d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f5868004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:00.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.725+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f58580632e0 con 0x7f587015e610 2024-09-17T04:26:00.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.909+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f587015ee60 con 0x7f5850078bc0 2024-09-17T04:26:00.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.911+0000 7f586d7fa640 1 -- 172.21.15.63:0/3372488983 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f58680053c0 con 0x7f5850078bc0 2024-09-17T04:26:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 msgr2=0x7f585007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 0x7f585007b0d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f5868004730 comp rx=0 tx=0).stop 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 msgr2=0x7f58700b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f585800e740 tx=0x7f585800ec00 comp rx=0 tx=0).stop 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 shutdown_connections 2024-09-17T04:26:00.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f5850078bc0 0x7f585007b0d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f587015e610 0x7f58700b4610 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58700cf540 0x7f58700ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 --2- 172.21.15.63:0/3372488983 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58700b9b60 0x7f58700cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 >> 172.21.15.63:0/3372488983 conn(0x7f587009d7f0 msgr2=0x7f587015f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 shutdown_connections 2024-09-17T04:26:00.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:00.912+0000 7f5876cb2640 1 -- 172.21.15.63:0/3372488983 wait complete. 2024-09-17T04:26:00.924 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T04:26:00.924 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 -- 172.21.15.63:0/3861758116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d0e20 msgr2=0x7f7d740d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 --2- 172.21.15.63:0/3861758116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d0e20 0x7f7d740d1230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009860 tx=0x7f7d5c02a4a0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 -- 172.21.15.63:0/3861758116 shutdown_connections 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 --2- 172.21.15.63:0/3861758116 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d0e20 0x7f7d740d1230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 -- 172.21.15.63:0/3861758116 >> 172.21.15.63:0/3861758116 conn(0x7f7d7409d800 msgr2=0x7f7d7408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 -- 172.21.15.63:0/3861758116 shutdown_connections 2024-09-17T04:26:01.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.045+0000 7f7d7987e640 1 -- 172.21.15.63:0/3861758116 wait complete. 2024-09-17T04:26:01.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.047+0000 7f7d7987e640 1 Processor -- start 2024-09-17T04:26:01.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.047+0000 7f7d7987e640 1 -- start start 2024-09-17T04:26:01.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 0x7f7d74167670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d740d0e20 0x7f7d74151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d2c70 0x7f7d741659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740d3d10 con 0x7f7d7406e0f0 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740d3b90 con 0x7f7d740d0e20 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d7987e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f7d740d3e90 con 0x7f7d740d2c70 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 0x7f7d74167670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 0x7f7d74167670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33414/0 (socket says 172.21.15.63:33414) 2024-09-17T04:26:01.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.048+0000 7f7d72ffd640 1 -- 172.21.15.63:0/2604142898 learned_addr learned my addr 172.21.15.63:0/2604142898 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d737fe640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d2c70 0x7f7d741659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d727fc640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d740d0e20 0x7f7d74151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 -- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d2c70 msgr2=0x7f7d741659c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d2c70 0x7f7d741659c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 -- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d740d0e20 msgr2=0x7f7d74151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f7d740d0e20 0x7f7d74151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d740ce580 con 0x7f7d7406e0f0 2024-09-17T04:26:01.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d737fe640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f7d740d2c70 0x7f7d741659c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d72ffd640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 0x7f7d74167670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c770 tx=0x7f7d6400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64003b70 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741609d0 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d64003d10 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6400aab0 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.049+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d74160f90 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.050+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d740d1230 con 0x7f7d7406e0f0 2024-09-17T04:26:01.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.051+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d6400ac50 con 0x7f7d7406e0f0 2024-09-17T04:26:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.051+0000 7f7d6bfff640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d54078bc0 0x7f7d5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f7d6409b330 con 0x7f7d7406e0f0 2024-09-17T04:26:01.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d727fc640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d54078bc0 0x7f7d5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d6bfff640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7f7d5407ead0 0x7f7d54080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d64004ec0 con 0x7f7d5407ead0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7d6409b7c0 con 0x7f7d7406e0f0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d737fe640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7f7d5407ead0 0x7f7d54080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d737fe640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7f7d5407ead0 0x7f7d54080f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.052+0000 7f7d727fc640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d54078bc0 0x7f7d5407b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c034000 tx=0x7f7d5c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.053+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== osd.1 v2:172.21.15.63:6800/3223774587 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d64004ec0 con 0x7f7d5407ead0 2024-09-17T04:26:01.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 --> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7d740d3190 con 0x7f7d5407ead0 2024-09-17T04:26:01.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d6bfff640 1 -- 172.21.15.63:0/2604142898 <== osd.1 v2:172.21.15.63:6800/3223774587 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7d740d3190 con 0x7f7d5407ead0 2024-09-17T04:26:01.067 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:01.067 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:01.067 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7f7d5407ead0 msgr2=0x7f7d54080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:6800/3223774587,v1:172.21.15.63:6801/3223774587] conn(0x7f7d5407ead0 0x7f7d54080f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d54078bc0 msgr2=0x7f7d5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f7d54078bc0 0x7f7d5407b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c034000 tx=0x7f7d5c004730 comp rx=0 tx=0).stop 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 msgr2=0x7f7d74167670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 --2- 172.21.15.63:0/2604142898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d7406e0f0 0x7f7d74167670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c770 tx=0x7f7d6400cc30 comp rx=0 tx=0).stop 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d737fe640 1 -- 172.21.15.63:0/2604142898 reap_dead start 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 shutdown_connections 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 >> 172.21.15.63:0/2604142898 conn(0x7f7d7409d800 msgr2=0x7f7d7408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 shutdown_connections 2024-09-17T04:26:01.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.066+0000 7f7d7987e640 1 -- 172.21.15.63:0/2604142898 wait complete. 2024-09-17T04:26:01.078 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 -- 172.21.15.63:0/3061959521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 msgr2=0x7f38680b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 --2- 172.21.15.63:0/3061959521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38680b63b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f386808d160 tx=0x7f385c02a5f0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 -- 172.21.15.63:0/3061959521 shutdown_connections 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 --2- 172.21.15.63:0/3061959521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38680b63b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 --2- 172.21.15.63:0/3061959521 >> v2:172.21.15.112:3300/0 conn(0x7f38680b9970 0x7f38680b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 -- 172.21.15.63:0/3061959521 >> 172.21.15.63:0/3061959521 conn(0x7f386809d7f0 msgr2=0x7f38680d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 -- 172.21.15.63:0/3061959521 shutdown_connections 2024-09-17T04:26:01.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.196+0000 7f386e9b0640 1 -- 172.21.15.63:0/3061959521 wait complete. 2024-09-17T04:26:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.197+0000 7f386e9b0640 1 Processor -- start 2024-09-17T04:26:01.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.198+0000 7f386e9b0640 1 -- start start 2024-09-17T04:26:01.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38680b9970 0x7f386815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38680ced80 0x7f38680c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f386806f270 con 0x7f38680b5fa0 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f386806f0f0 con 0x7f38680ced80 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386e9b0640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f386806f3f0 con 0x7f38680b9970 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33422/0 (socket says 172.21.15.63:33422) 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 -- 172.21.15.63:0/2462172996 learned_addr learned my addr 172.21.15.63:0/2462172996 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 -- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38680b9970 msgr2=0x7f386815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f38677fe640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38680b9970 0x7f386815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f386cf4d640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38680ced80 0x7f38680c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38680b9970 0x7f386815b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 -- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38680ced80 msgr2=0x7f38680c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38680ced80 0x7f38680c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.199+0000 7f3867fff640 1 -- 172.21.15.63:0/2462172996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38681f6240 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f3867fff640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f385800d700 tx=0x7f385800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858017070 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3858009d20 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38681f6740 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580106c0 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.200+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38680cab00 con 0x7f38680b5fa0 2024-09-17T04:26:01.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.201+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38680cfc40 con 0x7f38680b5fa0 2024-09-17T04:26:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.202+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f385801a070 con 0x7f38680b5fa0 2024-09-17T04:26:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.202+0000 7f3864ff9640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 0x7f385407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.202+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f385809ac10 con 0x7f38680b5fa0 2024-09-17T04:26:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.203+0000 7f38677fe640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 0x7f385407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.203+0000 7f38677fe640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 0x7f385407b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f385c033000 tx=0x7f385c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.207+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3858063350 con 0x7f38680b5fa0 2024-09-17T04:26:01.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.392+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f38680cf2c0 con 0x7f3854078b90 2024-09-17T04:26:01.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.393+0000 7f3864ff9640 1 -- 172.21.15.63:0/2462172996 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f38680cf2c0 con 0x7f3854078b90 2024-09-17T04:26:01.393 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T04:26:01.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 msgr2=0x7f385407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 0x7f385407b0a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f385c033000 tx=0x7f385c004730 comp rx=0 tx=0).stop 2024-09-17T04:26:01.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 msgr2=0x7f38681e84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f385800d700 tx=0x7f385800dbc0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 shutdown_connections 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f3854078b90 0x7f385407b0a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f38680ced80 0x7f38680c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f38680b9970 0x7f386815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 --2- 172.21.15.63:0/2462172996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38680b5fa0 0x7f38681e84c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 >> 172.21.15.63:0/2462172996 conn(0x7f386809d7f0 msgr2=0x7f386815e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 shutdown_connections 2024-09-17T04:26:01.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.395+0000 7f386e9b0640 1 -- 172.21.15.63:0/2462172996 wait complete. 2024-09-17T04:26:01.407 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T04:26:01.408 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:01.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.527+0000 7f87dff82640 1 -- 172.21.15.63:0/749751373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d80cfa70 msgr2=0x7f87d806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.527+0000 7f87dff82640 1 --2- 172.21.15.63:0/749751373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d80cfa70 0x7f87d806e610 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f87d809dfb0 tx=0x7f87c802a530 comp rx=0 tx=0).stop 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 -- 172.21.15.63:0/749751373 shutdown_connections 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 --2- 172.21.15.63:0/749751373 >> v2:172.21.15.112:3300/0 conn(0x7f87d80b96c0 0x7f87d80d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 --2- 172.21.15.63:0/749751373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d80cfa70 0x7f87d806e610 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 -- 172.21.15.63:0/749751373 >> 172.21.15.63:0/749751373 conn(0x7f87d809d8a0 msgr2=0x7f87d808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 -- 172.21.15.63:0/749751373 shutdown_connections 2024-09-17T04:26:01.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.528+0000 7f87dff82640 1 -- 172.21.15.63:0/749751373 wait complete. 2024-09-17T04:26:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.529+0000 7f87dff82640 1 Processor -- start 2024-09-17T04:26:01.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.529+0000 7f87dff82640 1 -- start start 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87d80b96c0 0x7f87d8157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87d80d18f0 0x7f87d80cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 0x7f87d80cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87d80d2db0 con 0x7f87d81f8db0 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f87d80d2c30 con 0x7f87d80b96c0 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dff82640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f87d80d2f30 con 0x7f87d80d18f0 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 0x7f87d80cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 0x7f87d80cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33440/0 (socket says 172.21.15.63:33440) 2024-09-17T04:26:01.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 -- 172.21.15.63:0/4212043590 learned_addr learned my addr 172.21.15.63:0/4212043590 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87ddd1e640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87d80b96c0 0x7f87d8157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87dd51d640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87d80d18f0 0x7f87d80cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 -- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87d80d18f0 msgr2=0x7f87d80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f87d80d18f0 0x7f87d80cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 -- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87d80b96c0 msgr2=0x7f87d8157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f87d80b96c0 0x7f87d8157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d81f9520 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.531+0000 7f87de51f640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 0x7f87d80cdd80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87d000cae0 tx=0x7f87d0007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0007da0 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87d0004c30 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005280 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d81f9800 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d80cccf0 con 0x7f87d81f8db0 2024-09-17T04:26:01.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.532+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87d81f9d20 con 0x7f87d81f8db0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87d0005420 con 0x7f87d81f8db0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f87bc078bc0 0x7f87bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f87d009ba40 con 0x7f87d81f8db0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f87bc07ead0 0x7f87bc080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87bc0815f0 con 0x7f87bc07ead0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.534+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f87d009bed0 con 0x7f87d81f8db0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.535+0000 7f87dd51d640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f87bc07ead0 0x7f87bc080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.535+0000 7f87ddd1e640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f87bc078bc0 0x7f87bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.535+0000 7f87dd51d640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f87bc07ead0 0x7f87bc080f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.535+0000 7f87ddd1e640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f87bc078bc0 0x7f87bc07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f87d4007fd0 tx=0x7f87d4001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.536+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== osd.2 v2:172.21.15.63:6824/59655443 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f87bc0815f0 con 0x7f87bc07ead0 2024-09-17T04:26:01.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.548+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 --> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f87d80ccf20 con 0x7f87bc07ead0 2024-09-17T04:26:01.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.548+0000 7f87ce7fc640 1 -- 172.21.15.63:0/4212043590 <== osd.2 v2:172.21.15.63:6824/59655443 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f87d80ccf20 con 0x7f87bc07ead0 2024-09-17T04:26:01.549 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:01.549 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:01.549 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f87bc07ead0 msgr2=0x7f87bc080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:6824/59655443,v1:172.21.15.63:6825/59655443] conn(0x7f87bc07ead0 0x7f87bc080f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f87bc078bc0 msgr2=0x7f87bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f87bc078bc0 0x7f87bc07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f87d4007fd0 tx=0x7f87d4001390 comp rx=0 tx=0).stop 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 msgr2=0x7f87d80cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 --2- 172.21.15.63:0/4212043590 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87d81f8db0 0x7f87d80cdd80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87d000cae0 tx=0x7f87d0007220 comp rx=0 tx=0).stop 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87de51f640 1 -- 172.21.15.63:0/4212043590 reap_dead start 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 shutdown_connections 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 >> 172.21.15.63:0/4212043590 conn(0x7f87d809d8a0 msgr2=0x7f87d8158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 shutdown_connections 2024-09-17T04:26:01.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.549+0000 7f87dff82640 1 -- 172.21.15.63:0/4212043590 wait complete. 2024-09-17T04:26:01.560 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 -- 172.21.15.63:0/1279624977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0b56f0 msgr2=0x7f14bc0b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 --2- 172.21.15.63:0/1279624977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0b56f0 0x7f14bc0b4c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0d1b10 tx=0x7f14ac02a560 comp rx=0 tx=0).stop 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 -- 172.21.15.63:0/1279624977 shutdown_connections 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 --2- 172.21.15.63:0/1279624977 >> v2:172.21.15.112:3300/0 conn(0x7f14bc0d12e0 0x7f14bc0d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 --2- 172.21.15.63:0/1279624977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0b56f0 0x7f14bc0b4c10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 -- 172.21.15.63:0/1279624977 >> 172.21.15.63:0/1279624977 conn(0x7f14bc09d620 msgr2=0x7f14bc0d4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 -- 172.21.15.63:0/1279624977 shutdown_connections 2024-09-17T04:26:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.677+0000 7f14c119d640 1 -- 172.21.15.63:0/1279624977 wait complete. 2024-09-17T04:26:01.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.678+0000 7f14c119d640 1 Processor -- start 2024-09-17T04:26:01.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.679+0000 7f14c119d640 1 -- start start 2024-09-17T04:26:01.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14bc0b56f0 0x7f14bc161b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14bc0d12e0 0x7f14bc1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc0d3040 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc0d2ec0 con 0x7f14bc0d12e0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c119d640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f14bc169040 con 0x7f14bc0b56f0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33450/0 (socket says 172.21.15.63:33450) 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 -- 172.21.15.63:0/3137815620 learned_addr learned my addr 172.21.15.63:0/3137815620 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bbfff640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14bc0b56f0 0x7f14bc161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14c099c640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14bc0d12e0 0x7f14bc1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 -- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14bc0b56f0 msgr2=0x7f14bc161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14bc0b56f0 0x7f14bc161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 -- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14bc0d12e0 msgr2=0x7f14bc1f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.680+0000 7f14bb7fe640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14bc0d12e0 0x7f14bc1f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14bb7fe640 1 -- 172.21.15.63:0/3137815620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc1f6aa0 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14bb7fe640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c3d0 tx=0x7f14b000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0017070 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14b00053c0 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0003850 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc14de80 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.681+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc14d3a0 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.682+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc0b4c10 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.683+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14b001a070 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.683+0000 7f14b8ff9640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 0x7f14a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.683+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f14b0099d90 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.684+0000 7f14bbfff640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 0x7f14a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:01.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.684+0000 7f14bbfff640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 0x7f14a807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14ac034000 tx=0x7f14ac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:01.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.688+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14b0061e80 con 0x7f14bc0d0ed0 2024-09-17T04:26:01.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.873+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f14bc0d1b40 con 0x7f14a8078b90 2024-09-17T04:26:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.874+0000 7f14b8ff9640 1 -- 172.21.15.63:0/3137815620 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f14bc0d1b40 con 0x7f14a8078b90 2024-09-17T04:26:01.875 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T04:26:01.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 msgr2=0x7f14a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 0x7f14a807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f14ac034000 tx=0x7f14ac004730 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 msgr2=0x7f14bc1f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c3d0 tx=0x7f14b000c890 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 shutdown_connections 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f14a8078b90 0x7f14a807b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f14bc0d12e0 0x7f14bc1f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14bc0d0ed0 0x7f14bc1f5d20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 --2- 172.21.15.63:0/3137815620 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f14bc0b56f0 0x7f14bc161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 >> 172.21.15.63:0/3137815620 conn(0x7f14bc09d620 msgr2=0x7f14bc0b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 shutdown_connections 2024-09-17T04:26:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:01.876+0000 7f14c119d640 1 -- 172.21.15.63:0/3137815620 wait complete. 2024-09-17T04:26:01.889 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T04:26:01.889 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 -- 172.21.15.63:0/4141110026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c06ded0 msgr2=0x7fc62c0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 --2- 172.21.15.63:0/4141110026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c06ded0 0x7fc62c0d0f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009900 tx=0x7fc61c02a530 comp rx=0 tx=0).stop 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 -- 172.21.15.63:0/4141110026 shutdown_connections 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 --2- 172.21.15.63:0/4141110026 >> v2:172.21.15.112:3300/0 conn(0x7fc62c0b38a0 0x7fc62c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 --2- 172.21.15.63:0/4141110026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c06ded0 0x7fc62c0d0f30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 -- 172.21.15.63:0/4141110026 >> 172.21.15.63:0/4141110026 conn(0x7fc62c09d820 msgr2=0x7fc62c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 -- 172.21.15.63:0/4141110026 shutdown_connections 2024-09-17T04:26:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.010+0000 7fc630886640 1 -- 172.21.15.63:0/4141110026 wait complete. 2024-09-17T04:26:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.012+0000 7fc630886640 1 Processor -- start 2024-09-17T04:26:02.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.012+0000 7fc630886640 1 -- start start 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc62c06ded0 0x7fc62c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 0x7fc62c1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc62c0d3f80 0x7fc62c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0b6830 con 0x7fc62c0b38a0 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0b66b0 con 0x7fc62c06ded0 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc630886640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0b69b0 con 0x7fc62c0d3f80 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 0x7fc62c1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 0x7fc62c1f5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33468/0 (socket says 172.21.15.63:33468) 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 -- 172.21.15.63:0/3245742527 learned_addr learned my addr 172.21.15.63:0/3245742527 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc62a59c640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc62c06ded0 0x7fc62c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc62ad9d640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc62c0d3f80 0x7fc62c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 -- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc62c0d3f80 msgr2=0x7fc62c1f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc62c0d3f80 0x7fc62c1f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 -- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc62c06ded0 msgr2=0x7fc62c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc62c06ded0 0x7fc62c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.013+0000 7fc629d9b640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c1f6500 con 0x7fc62c0b38a0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc629d9b640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 0x7fc62c1f5760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c9a0 tx=0x7fc62000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620007bb0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc620007e40 con 0x7fc62c0b38a0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c0cc6e0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620005280 con 0x7fc62c0b38a0 2024-09-17T04:26:02.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.014+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c0ccca0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.015+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc62c0b5fa0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc620005420 con 0x7fc62c0b38a0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc60c078b90 0x7fc60c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc62009adf0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7fc60c07eaa0 0x7fc60c080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc620004490 con 0x7fc60c07eaa0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc62009d4f0 con 0x7fc62c0b38a0 2024-09-17T04:26:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc62a59c640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc60c078b90 0x7fc60c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.016+0000 7fc62ad9d640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7fc60c07eaa0 0x7fc60c080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.017+0000 7fc62ad9d640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7fc60c07eaa0 0x7fc60c080ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.017+0000 7fc62a59c640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc60c078b90 0x7fc60c07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc61c033000 tx=0x7fc61c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.017+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== osd.3 v2:172.21.15.63:6808/126176733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc620004490 con 0x7fc60c07eaa0 2024-09-17T04:26:02.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.030+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 --> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc62c1f62b0 con 0x7fc60c07eaa0 2024-09-17T04:26:02.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.030+0000 7fc61affd640 1 -- 172.21.15.63:0/3245742527 <== osd.3 v2:172.21.15.63:6808/126176733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc62c1f62b0 con 0x7fc60c07eaa0 2024-09-17T04:26:02.031 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:02.031 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:02.032 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:02.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7fc60c07eaa0 msgr2=0x7fc60c080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:6808/126176733,v1:172.21.15.63:6809/126176733] conn(0x7fc60c07eaa0 0x7fc60c080ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc60c078b90 msgr2=0x7fc60c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc60c078b90 0x7fc60c07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc61c033000 tx=0x7fc61c004730 comp rx=0 tx=0).stop 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 msgr2=0x7fc62c1f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 --2- 172.21.15.63:0/3245742527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc62c0b38a0 0x7fc62c1f5760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c9a0 tx=0x7fc62000ce60 comp rx=0 tx=0).stop 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc62ad9d640 1 -- 172.21.15.63:0/3245742527 reap_dead start 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 shutdown_connections 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 >> 172.21.15.63:0/3245742527 conn(0x7fc62c09d820 msgr2=0x7fc62c0b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 shutdown_connections 2024-09-17T04:26:02.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.031+0000 7fc630886640 1 -- 172.21.15.63:0/3245742527 wait complete. 2024-09-17T04:26:02.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T04:26:02.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 -- 172.21.15.63:0/2499509846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07880053a0 msgr2=0x7f078800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 --2- 172.21.15.63:0/2499509846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07880053a0 0x7f078800ba50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0794001d90 tx=0x7f0788005830 comp rx=0 tx=0).stop 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 -- 172.21.15.63:0/2499509846 shutdown_connections 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 --2- 172.21.15.63:0/2499509846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07880053a0 0x7f078800ba50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 -- 172.21.15.63:0/2499509846 >> 172.21.15.63:0/2499509846 conn(0x7f079c09d840 msgr2=0x7f079c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 -- 172.21.15.63:0/2499509846 shutdown_connections 2024-09-17T04:26:02.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.160+0000 7f07a3b58640 1 -- 172.21.15.63:0/2499509846 wait complete. 2024-09-17T04:26:02.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.162+0000 7f07a3b58640 1 Processor -- start 2024-09-17T04:26:02.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.162+0000 7f07a3b58640 1 -- start start 2024-09-17T04:26:02.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.163+0000 7f07a3b58640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880053a0 0x7f079c159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.163+0000 7f07a3b58640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f079c0b6820 0x7f079c1f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a3b58640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a3b58640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0b9b70 con 0x7f079c1f91c0 2024-09-17T04:26:02.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a3b58640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0b99f0 con 0x7f079c0b6820 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a3b58640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f079c06e610 con 0x7f07880053a0 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33494/0 (socket says 172.21.15.63:33494) 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 -- 172.21.15.63:0/1554198515 learned_addr learned my addr 172.21.15.63:0/1554198515 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a18f4640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880053a0 0x7f079c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a10f3640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f079c0b6820 0x7f079c1f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 -- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880053a0 msgr2=0x7f079c159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880053a0 0x7f079c159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 -- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f079c0b6820 msgr2=0x7f079c1f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f079c0b6820 0x7f079c1f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 -- 172.21.15.63:0/1554198515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c1f95d0 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a20f5640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0794001eb0 tx=0x7f0794006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794003d80 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0794005b00 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c15be30 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.164+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794005f30 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.165+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c15c3f0 con 0x7f079c1f91c0 2024-09-17T04:26:02.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.165+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079c0cc650 con 0x7f079c1f91c0 2024-09-17T04:26:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.166+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07940060d0 con 0x7f079c1f91c0 2024-09-17T04:26:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.167+0000 7f078e7fc640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.167+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f07940ba7c0 con 0x7f079c1f91c0 2024-09-17T04:26:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.167+0000 7f07a18f4640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.167+0000 7f07a18f4640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 0x7f078007b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07980058e0 tx=0x7f0798005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.171+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f079c1f95d0 con 0x7f079c1f91c0 2024-09-17T04:26:02.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.355+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f079c1f9ad0 con 0x7f0780078b90 2024-09-17T04:26:02.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.357+0000 7f078e7fc640 1 -- 172.21.15.63:0/1554198515 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0798012be0 con 0x7f0780078b90 2024-09-17T04:26:02.357 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 msgr2=0x7f078007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 0x7f078007b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07980058e0 tx=0x7f0798005f30 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 msgr2=0x7f079c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0794001eb0 tx=0x7f0794006ca0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 shutdown_connections 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0780078b90 0x7f078007b0a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f079c0b6820 0x7f079c1f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f079c1f91c0 0x7f079c0ccd80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 --2- 172.21.15.63:0/1554198515 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f07880053a0 0x7f079c159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 >> 172.21.15.63:0/1554198515 conn(0x7f079c09d840 msgr2=0x7f079c1589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 shutdown_connections 2024-09-17T04:26:02.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.358+0000 7f07a3b58640 1 -- 172.21.15.63:0/1554198515 wait complete. 2024-09-17T04:26:02.370 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T04:26:02.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:02.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 -- 172.21.15.63:0/520688424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac06ded0 msgr2=0x7f58ac0d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/520688424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac06ded0 0x7f58ac0d0f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0b9d80 tx=0x7f589c02a4d0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 -- 172.21.15.63:0/520688424 shutdown_connections 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/520688424 >> v2:172.21.15.112:3300/0 conn(0x7f58ac0d3f80 0x7f58ac0b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/520688424 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58ac0b38a0 0x7f58ac0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/520688424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac06ded0 0x7f58ac0d0f30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 -- 172.21.15.63:0/520688424 >> 172.21.15.63:0/520688424 conn(0x7f58ac09d820 msgr2=0x7f58ac08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 -- 172.21.15.63:0/520688424 shutdown_connections 2024-09-17T04:26:02.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.489+0000 7f58b1ae5640 1 -- 172.21.15.63:0/520688424 wait complete. 2024-09-17T04:26:02.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.491+0000 7f58b1ae5640 1 Processor -- start 2024-09-17T04:26:02.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.491+0000 7f58b1ae5640 1 -- start start 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac06ded0 0x7f58ac0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58ac0b38a0 0x7f58ac0a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 0x7f58ac151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0b69e0 con 0x7f58ac0d3f80 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0b6860 con 0x7f58ac06ded0 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58b1ae5640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac0b6b60 con 0x7f58ac0b38a0 2024-09-17T04:26:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 0x7f58ac151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac06ded0 0x7f58ac0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 0x7f58ac151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33498/0 (socket says 172.21.15.63:33498) 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 -- 172.21.15.63:0/1720713282 learned_addr learned my addr 172.21.15.63:0/1720713282 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58aaffd640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58ac0b38a0 0x7f58ac0a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 -- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58ac0b38a0 msgr2=0x7f58ac0a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f58ac0b38a0 0x7f58ac0a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 -- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac06ded0 msgr2=0x7f58ac0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f58ac06ded0 0x7f58ac0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.493+0000 7f58abfff640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0a2140 con 0x7f58ac0d3f80 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58abfff640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 0x7f58ac151990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58a400cab0 tx=0x7f58a400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4007d90 con 0x7f58ac0d3f80 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58a400f540 con 0x7f58ac0d3f80 2024-09-17T04:26:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac0cbdc0 con 0x7f58ac0d3f80 2024-09-17T04:26:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a400f990 con 0x7f58ac0d3f80 2024-09-17T04:26:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.494+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac0cc380 con 0x7f58ac0d3f80 2024-09-17T04:26:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.495+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58ac0b5fa0 con 0x7f58ac0d3f80 2024-09-17T04:26:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.495+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58a400fb30 con 0x7f58ac0d3f80 2024-09-17T04:26:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58a3fff640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f588c078b90 0x7f588c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f58a409b360 con 0x7f58ac0d3f80 2024-09-17T04:26:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58a3fff640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f588c07eaa0 0x7f588c080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f588c0815c0 con 0x7f588c07eaa0 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f58a40a2050 con 0x7f58ac0d3f80 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58ab7fe640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f588c078b90 0x7f588c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.496+0000 7f58aaffd640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f588c07eaa0 0x7f588c080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.497+0000 7f58ab7fe640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f588c078b90 0x7f588c07b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f589c033000 tx=0x7f589c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.497+0000 7f58aaffd640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f588c07eaa0 0x7f588c080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.498+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== osd.4 v2:172.21.15.112:6826/4200339545 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f588c0815c0 con 0x7f588c07eaa0 2024-09-17T04:26:02.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.510+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 --> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f58ac0cbb70 con 0x7f588c07eaa0 2024-09-17T04:26:02.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58a3fff640 1 -- 172.21.15.63:0/1720713282 <== osd.4 v2:172.21.15.112:6826/4200339545 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f58ac0cbb70 con 0x7f588c07eaa0 2024-09-17T04:26:02.512 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:02.512 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:02.512 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:02.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f588c07eaa0 msgr2=0x7f588c080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6826/4200339545,v1:172.21.15.112:6827/4200339545] conn(0x7f588c07eaa0 0x7f588c080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f588c078b90 msgr2=0x7f588c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f588c078b90 0x7f588c07b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f589c033000 tx=0x7f589c004730 comp rx=0 tx=0).stop 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 msgr2=0x7f58ac151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 --2- 172.21.15.63:0/1720713282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58ac0d3f80 0x7f58ac151990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58a400cab0 tx=0x7f58a400cf70 comp rx=0 tx=0).stop 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58abfff640 1 -- 172.21.15.63:0/1720713282 reap_dead start 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 shutdown_connections 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 >> 172.21.15.63:0/1720713282 conn(0x7f58ac09d820 msgr2=0x7f58ac0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 shutdown_connections 2024-09-17T04:26:02.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.511+0000 7f58b1ae5640 1 -- 172.21.15.63:0/1720713282 wait complete. 2024-09-17T04:26:02.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T04:26:02.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 -- 172.21.15.63:0/505794950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b9970 msgr2=0x7fec900b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 --2- 172.21.15.63:0/505794950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b9970 0x7fec900b3710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec80009820 tx=0x7fec8002a510 comp rx=0 tx=0).stop 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 -- 172.21.15.63:0/505794950 shutdown_connections 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 --2- 172.21.15.63:0/505794950 >> v2:172.21.15.112:3300/0 conn(0x7fec9006e0e0 0x7fec9006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 --2- 172.21.15.63:0/505794950 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b9970 0x7fec900b3710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 -- 172.21.15.63:0/505794950 >> 172.21.15.63:0/505794950 conn(0x7fec9009d7f0 msgr2=0x7fec900d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 -- 172.21.15.63:0/505794950 shutdown_connections 2024-09-17T04:26:02.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.640+0000 7fec96238640 1 -- 172.21.15.63:0/505794950 wait complete. 2024-09-17T04:26:02.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.642+0000 7fec96238640 1 Processor -- start 2024-09-17T04:26:02.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.642+0000 7fec96238640 1 -- start start 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b5fa0 0x7fec900ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec900b9970 0x7fec900cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec9006ea30 con 0x7fec9006e0e0 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fec900d5050 con 0x7fec900b9970 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec96238640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fec9006ebb0 con 0x7fec900b5fa0 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33506/0 (socket says 172.21.15.63:33506) 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 -- 172.21.15.63:0/867079605 learned_addr learned my addr 172.21.15.63:0/867079605 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8effd640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b5fa0 0x7fec900ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8ffff640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec900b9970 0x7fec900cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 -- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b5fa0 msgr2=0x7fec900ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b5fa0 0x7fec900ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 -- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec900b9970 msgr2=0x7fec900cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec900b9970 0x7fec900cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 -- 172.21.15.63:0/867079605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901f64c0 con 0x7fec9006e0e0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec8f7fe640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fec8002ab00 tx=0x7fec80004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.644+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8003f070 con 0x7fec9006e0e0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.645+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec80004e50 con 0x7fec9006e0e0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.645+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec90159f50 con 0x7fec9006e0e0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.645+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80005c30 con 0x7fec9006e0e0 2024-09-17T04:26:02.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.645+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901f8fc0 con 0x7fec9006e0e0 2024-09-17T04:26:02.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.646+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec900cb640 con 0x7fec9006e0e0 2024-09-17T04:26:02.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.646+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec80042070 con 0x7fec9006e0e0 2024-09-17T04:26:02.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.647+0000 7fec77fff640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 0x7fec7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.647+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fec800bb970 con 0x7fec9006e0e0 2024-09-17T04:26:02.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.647+0000 7fec8effd640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 0x7fec7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.648+0000 7fec8effd640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 0x7fec7c07b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec900c7ee0 tx=0x7fec84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.651+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec800840b0 con 0x7fec9006e0e0 2024-09-17T04:26:02.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.836+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fec9006f080 con 0x7fec7c078bc0 2024-09-17T04:26:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.836+0000 7fec77fff640 1 -- 172.21.15.63:0/867079605 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec9006f080 con 0x7fec7c078bc0 2024-09-17T04:26:02.837 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T04:26:02.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 msgr2=0x7fec7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 0x7fec7c07b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec900c7ee0 tx=0x7fec84009040 comp rx=0 tx=0).stop 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 msgr2=0x7fec90159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fec8002ab00 tx=0x7fec80004a50 comp rx=0 tx=0).stop 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 shutdown_connections 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fec7c078bc0 0x7fec7c07b0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fec900b9970 0x7fec900cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fec900b5fa0 0x7fec900ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 --2- 172.21.15.63:0/867079605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec9006e0e0 0x7fec90159a10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 >> 172.21.15.63:0/867079605 conn(0x7fec9009d7f0 msgr2=0x7fec9015c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 shutdown_connections 2024-09-17T04:26:02.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.839+0000 7fec96238640 1 -- 172.21.15.63:0/867079605 wait complete. 2024-09-17T04:26:02.851 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T04:26:02.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:02.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 -- 172.21.15.63:0/2518289410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 msgr2=0x7f2d380d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/2518289410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d380d0950 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2d380d0660 tx=0x7f2d2802a560 comp rx=0 tx=0).stop 2024-09-17T04:26:02.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 -- 172.21.15.63:0/2518289410 shutdown_connections 2024-09-17T04:26:02.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/2518289410 >> v2:172.21.15.112:3300/0 conn(0x7f2d380b2270 0x7f2d380ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/2518289410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d380d0950 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 -- 172.21.15.63:0/2518289410 >> 172.21.15.63:0/2518289410 conn(0x7f2d380ced80 msgr2=0x7f2d380cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 -- 172.21.15.63:0/2518289410 shutdown_connections 2024-09-17T04:26:02.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.972+0000 7f2d3cca9640 1 -- 172.21.15.63:0/2518289410 wait complete. 2024-09-17T04:26:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.974+0000 7f2d3cca9640 1 Processor -- start 2024-09-17T04:26:02.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.974+0000 7f2d3cca9640 1 -- start start 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d380b2270 0x7f2d3815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d3815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d380d0e90 0x7f2d381e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b18b0 con 0x7f2d380b7a00 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f2d380b1730 con 0x7f2d380d0e90 2024-09-17T04:26:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3cca9640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f2d380b2680 con 0x7f2d380b2270 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d35d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d3815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d35d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d3815edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33524/0 (socket says 172.21.15.63:33524) 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d35d9b640 1 -- 172.21.15.63:0/1051747726 learned_addr learned my addr 172.21.15.63:0/1051747726 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d3659c640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d380b2270 0x7f2d3815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.975+0000 7f2d36d9d640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d380d0e90 0x7f2d381e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 -- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d380b2270 msgr2=0x7f2d3815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f2d380b2270 0x7f2d3815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 -- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d380d0e90 msgr2=0x7f2d381e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f2d380d0e90 0x7f2d381e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d38153b00 con 0x7f2d380b7a00 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d35d9b640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d3815edb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c340 tx=0x7f2d2c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c017070 con 0x7f2d380b7a00 2024-09-17T04:26:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d2c0053c0 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3815f680 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003850 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.976+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3815fc40 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.977+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d380d0950 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d2c01a070 con 0x7f2d380b7a00 2024-09-17T04:26:02.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2d18078bc0 0x7f2d1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f2d2c099cb0 con 0x7f2d380b7a00 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7f2d1807ead0 0x7f2d18080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d2c016ec0 con 0x7f2d1807ead0 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.978+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c09c3b0 con 0x7f2d380b7a00 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.979+0000 7f2d3659c640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2d18078bc0 0x7f2d1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.979+0000 7f2d36d9d640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7f2d1807ead0 0x7f2d18080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.979+0000 7f2d3659c640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2d18078bc0 0x7f2d1807b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d28004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.979+0000 7f2d36d9d640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7f2d1807ead0 0x7f2d18080f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.980+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== osd.5 v2:172.21.15.112:6802/3916391572 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d2c016ec0 con 0x7f2d1807ead0 2024-09-17T04:26:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 --> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2d3815fe40 con 0x7f2d1807ead0 2024-09-17T04:26:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d26ffd640 1 -- 172.21.15.63:0/1051747726 <== osd.5 v2:172.21.15.112:6802/3916391572 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2d3815fe40 con 0x7f2d1807ead0 2024-09-17T04:26:02.994 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:02.994 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:02.994 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7f2d1807ead0 msgr2=0x7f2d18080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6802/3916391572,v1:172.21.15.112:6803/3916391572] conn(0x7f2d1807ead0 0x7f2d18080f20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2d18078bc0 msgr2=0x7f2d1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f2d18078bc0 0x7f2d1807b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d28034000 tx=0x7f2d28004730 comp rx=0 tx=0).stop 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 msgr2=0x7f2d3815edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.993+0000 7f2d3cca9640 1 --2- 172.21.15.63:0/1051747726 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2d380b7a00 0x7f2d3815edb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c340 tx=0x7f2d2c00c800 comp rx=0 tx=0).stop 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.994+0000 7f2d36d9d640 1 -- 172.21.15.63:0/1051747726 reap_dead start 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.994+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 shutdown_connections 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.994+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 >> 172.21.15.63:0/1051747726 conn(0x7f2d380ced80 msgr2=0x7f2d380af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.994+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 shutdown_connections 2024-09-17T04:26:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:02.994+0000 7f2d3cca9640 1 -- 172.21.15.63:0/1051747726 wait complete. 2024-09-17T04:26:03.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T04:26:03.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 -- 172.21.15.63:0/1859758645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cf440 msgr2=0x7fc8180d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 --2- 172.21.15.63:0/1859758645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cf440 0x7fc8180d0190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc8180747a0 tx=0x7fc81002aa30 comp rx=0 tx=0).stop 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 -- 172.21.15.63:0/1859758645 shutdown_connections 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 --2- 172.21.15.63:0/1859758645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cf440 0x7fc8180d0190 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 --2- 172.21.15.63:0/1859758645 >> v2:172.21.15.112:3300/0 conn(0x7fc8180cd360 0x7fc81815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 -- 172.21.15.63:0/1859758645 >> 172.21.15.63:0/1859758645 conn(0x7fc8180710b0 msgr2=0x7fc8180714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 -- 172.21.15.63:0/1859758645 shutdown_connections 2024-09-17T04:26:03.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.122+0000 7fc81d321640 1 -- 172.21.15.63:0/1859758645 wait complete. 2024-09-17T04:26:03.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.124+0000 7fc81d321640 1 Processor -- start 2024-09-17T04:26:03.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.124+0000 7fc81d321640 1 -- start start 2024-09-17T04:26:03.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.125+0000 7fc81d321640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8180b7fe0 0x7fc8181475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.125+0000 7fc81d321640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8180c6fc0 0x7fc8181f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d0b40 con 0x7fc8180cd360 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180d09c0 con 0x7fc8180b7fe0 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180d0cc0 con 0x7fc8180c6fc0 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33534/0 (socket says 172.21.15.63:33534) 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 -- 172.21.15.63:0/2871946347 learned_addr learned my addr 172.21.15.63:0/2871946347 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc816ffd640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8180b7fe0 0x7fc8181475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8177fe640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8180c6fc0 0x7fc8181f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 -- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8180c6fc0 msgr2=0x7fc8181f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8180c6fc0 0x7fc8181f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 -- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8180b7fe0 msgr2=0x7fc8181475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8180b7fe0 0x7fc8181475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 -- 172.21.15.63:0/2871946347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8180c7700 con 0x7fc8180cd360 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc8167fc640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c3a0 tx=0x7fc80c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c017070 con 0x7fc8180cd360 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc80c0053c0 con 0x7fc8180cd360 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8180c79e0 con 0x7fc8180cd360 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c003850 con 0x7fc8180cd360 2024-09-17T04:26:03.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.126+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81815e5a0 con 0x7fc8180cd360 2024-09-17T04:26:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.127+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8180c7470 con 0x7fc8180cd360 2024-09-17T04:26:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.128+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc80c01a070 con 0x7fc8180cd360 2024-09-17T04:26:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.129+0000 7fc7ff7fe640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 0x7fc80407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.129+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc80c099ca0 con 0x7fc8180cd360 2024-09-17T04:26:03.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.129+0000 7fc816ffd640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 0x7fc80407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.130+0000 7fc816ffd640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 0x7fc80407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bb50 tx=0x7fc80800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.134+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc80c061e20 con 0x7fc8180cd360 2024-09-17T04:26:03.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.319+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc8180d1170 con 0x7fc804078bc0 2024-09-17T04:26:03.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.320+0000 7fc7ff7fe640 1 -- 172.21.15.63:0/2871946347 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc8180d1170 con 0x7fc804078bc0 2024-09-17T04:26:03.320 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T04:26:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 msgr2=0x7fc80407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 0x7fc80407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bb50 tx=0x7fc80800b2e0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 msgr2=0x7fc8180c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00c3a0 tx=0x7fc80c00c860 comp rx=0 tx=0).stop 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 shutdown_connections 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fc804078bc0 0x7fc80407b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fc8180c6fc0 0x7fc8181f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8180cd360 0x7fc8180c6a80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 --2- 172.21.15.63:0/2871946347 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fc8180b7fe0 0x7fc8181475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 >> 172.21.15.63:0/2871946347 conn(0x7fc8180710b0 msgr2=0x7fc81815b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 shutdown_connections 2024-09-17T04:26:03.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.322+0000 7fc81d321640 1 -- 172.21.15.63:0/2871946347 wait complete. 2024-09-17T04:26:03.335 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T04:26:03.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 -- 172.21.15.63:0/3448453505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa74003a30 msgr2=0x7ffa74003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 --2- 172.21.15.63:0/3448453505 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa74003a30 0x7ffa74003ea0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009b50 tx=0x7ffa74005830 comp rx=0 tx=0).stop 2024-09-17T04:26:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa9127b640 1 -- 172.21.15.63:0/3448453505 reap_dead start 2024-09-17T04:26:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 -- 172.21.15.63:0/3448453505 shutdown_connections 2024-09-17T04:26:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 -- 172.21.15.63:0/3448453505 >> 172.21.15.63:0/3448453505 conn(0x7ffa8c09d8a0 msgr2=0x7ffa8c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 -- 172.21.15.63:0/3448453505 shutdown_connections 2024-09-17T04:26:03.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.455+0000 7ffa92cde640 1 -- 172.21.15.63:0/3448453505 wait complete. 2024-09-17T04:26:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.457+0000 7ffa92cde640 1 Processor -- start 2024-09-17T04:26:03.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.457+0000 7ffa92cde640 1 -- start start 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa74003a30 0x7ffa8c151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 0x7ffa8c0a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa8c09e310 0x7ffa8c09e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c0d2b00 con 0x7ffa8c0a0360 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c06e9b0 con 0x7ffa74003a30 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa92cde640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8c0d2c80 con 0x7ffa8c09e310 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 0x7ffa8c0a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 0x7ffa8c0a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33556/0 (socket says 172.21.15.63:33556) 2024-09-17T04:26:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 -- 172.21.15.63:0/3501324937 learned_addr learned my addr 172.21.15.63:0/3501324937 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa90a7a640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa74003a30 0x7ffa8c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa9127b640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa8c09e310 0x7ffa8c09e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 -- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa8c09e310 msgr2=0x7ffa8c09e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ffa8c09e310 0x7ffa8c09e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 -- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa74003a30 msgr2=0x7ffa8c151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ffa74003a30 0x7ffa8c151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c09ec60 con 0x7ffa8c0a0360 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa83fff640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 0x7ffa8c0a1b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c003f50 tx=0x7ffa7c00f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.459+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c015070 con 0x7ffa8c0a0360 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.460+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa7c011840 con 0x7ffa8c0a0360 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.460+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c1e8430 con 0x7ffa8c0a0360 2024-09-17T04:26:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.460+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c011c70 con 0x7ffa8c0a0360 2024-09-17T04:26:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.460+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c152650 con 0x7ffa8c0a0360 2024-09-17T04:26:03.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.460+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa8c0d23f0 con 0x7ffa8c0a0360 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.461+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa7c0243e0 con 0x7ffa8c0a0360 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa817fa640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ffa78078b90 0x7ffa7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ffa7c09bc90 con 0x7ffa8c0a0360 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa90a7a640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ffa78078b90 0x7ffa7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa817fa640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7ffa7807eaa0 0x7ffa78080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa780815c0 con 0x7ffa7807eaa0 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffa7c09c120 con 0x7ffa8c0a0360 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.462+0000 7ffa9127b640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7ffa7807eaa0 0x7ffa78080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.463+0000 7ffa90a7a640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ffa78078b90 0x7ffa7807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa88035000 tx=0x7ffa8802d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.463+0000 7ffa9127b640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7ffa7807eaa0 0x7ffa78080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.464+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== osd.6 v2:172.21.15.112:6810/3726125666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa780815c0 con 0x7ffa7807eaa0 2024-09-17T04:26:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.476+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 --> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffa8c0d5130 con 0x7ffa7807eaa0 2024-09-17T04:26:03.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa817fa640 1 -- 172.21.15.63:0/3501324937 <== osd.6 v2:172.21.15.112:6810/3726125666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffa8c0d5130 con 0x7ffa7807eaa0 2024-09-17T04:26:03.478 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:03.478 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:03.478 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7ffa7807eaa0 msgr2=0x7ffa78080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6810/3726125666,v1:172.21.15.112:6811/3726125666] conn(0x7ffa7807eaa0 0x7ffa78080ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ffa78078b90 msgr2=0x7ffa7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ffa78078b90 0x7ffa7807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa88035000 tx=0x7ffa8802d040 comp rx=0 tx=0).stop 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 msgr2=0x7ffa8c0a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 --2- 172.21.15.63:0/3501324937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa8c0a0360 0x7ffa8c0a1b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c003f50 tx=0x7ffa7c00f7e0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa9127b640 1 -- 172.21.15.63:0/3501324937 reap_dead start 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 shutdown_connections 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 >> 172.21.15.63:0/3501324937 conn(0x7ffa8c09d8a0 msgr2=0x7ffa8c161870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 shutdown_connections 2024-09-17T04:26:03.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.477+0000 7ffa92cde640 1 -- 172.21.15.63:0/3501324937 wait complete. 2024-09-17T04:26:03.489 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 -- 172.21.15.63:0/661480267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b97e0 msgr2=0x7f420c06f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 --2- 172.21.15.63:0/661480267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b97e0 0x7f420c06f6e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f41fc005fd0 tx=0x7f41fc02a4b0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 -- 172.21.15.63:0/661480267 shutdown_connections 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 --2- 172.21.15.63:0/661480267 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c0d0e50 0x7f420c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 --2- 172.21.15.63:0/661480267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0b97e0 0x7f420c06f6e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 -- 172.21.15.63:0/661480267 >> 172.21.15.63:0/661480267 conn(0x7f420c09d840 msgr2=0x7f420c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 -- 172.21.15.63:0/661480267 shutdown_connections 2024-09-17T04:26:03.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.606+0000 7f4213c3f640 1 -- 172.21.15.63:0/661480267 wait complete. 2024-09-17T04:26:03.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.608+0000 7f4213c3f640 1 Processor -- start 2024-09-17T04:26:03.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.608+0000 7f4213c3f640 1 -- start start 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c06e0a0 0x7f420c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f420c0b97e0 0x7f420c1f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f420c0cfea0 con 0x7f420c0d0e50 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f420c0cfd20 con 0x7f420c0b97e0 2024-09-17T04:26:03.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f4213c3f640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f420c0d0020 con 0x7f420c06e0a0 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33578/0 (socket says 172.21.15.63:33578) 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 -- 172.21.15.63:0/3256844249 learned_addr learned my addr 172.21.15.63:0/3256844249 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42119db640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c06e0a0 0x7f420c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42111da640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f420c0b97e0 0x7f420c1f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 -- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c06e0a0 msgr2=0x7f420c1f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c06e0a0 0x7f420c1f5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 -- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f420c0b97e0 msgr2=0x7f420c1f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f420c0b97e0 0x7f420c1f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.609+0000 7f42121dc640 1 -- 172.21.15.63:0/3256844249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c161130 con 0x7f420c0d0e50 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f42121dc640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f420400e990 tx=0x7f420400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204004d20 con 0x7f420c0d0e50 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f420400caa0 con 0x7f420c0d0e50 2024-09-17T04:26:03.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c1f6510 con 0x7f420c0d0e50 2024-09-17T04:26:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204005020 con 0x7f420c0d0e50 2024-09-17T04:26:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.610+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c0cca90 con 0x7f420c0d0e50 2024-09-17T04:26:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.611+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420c1f6280 con 0x7f420c0d0e50 2024-09-17T04:26:03.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.612+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42040051c0 con 0x7f420c0d0e50 2024-09-17T04:26:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.612+0000 7f42027fc640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 0x7f41f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.612+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f420409b270 con 0x7f420c0d0e50 2024-09-17T04:26:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.613+0000 7f42119db640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 0x7f41f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.613+0000 7f42119db640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 0x7f41f007b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4208007fd0 tx=0x7f4208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.617+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4204016030 con 0x7f420c0d0e50 2024-09-17T04:26:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.803+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f420c0d0420 con 0x7f41f0078bc0 2024-09-17T04:26:03.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.803+0000 7f42027fc640 1 -- 172.21.15.63:0/3256844249 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f420c0d0420 con 0x7f41f0078bc0 2024-09-17T04:26:03.805 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 msgr2=0x7f41f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 0x7f41f007b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4208007fd0 tx=0x7f4208009040 comp rx=0 tx=0).stop 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 msgr2=0x7f420c1f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f420400e990 tx=0x7f420400ee50 comp rx=0 tx=0).stop 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 shutdown_connections 2024-09-17T04:26:03.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f41f0078bc0 0x7f41f007b0d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f420c0b97e0 0x7f420c1f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f420c0d0e50 0x7f420c1f9640 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 --2- 172.21.15.63:0/3256844249 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f420c06e0a0 0x7f420c1f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 >> 172.21.15.63:0/3256844249 conn(0x7f420c09d840 msgr2=0x7f420c161d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 shutdown_connections 2024-09-17T04:26:03.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.806+0000 7f4213c3f640 1 -- 172.21.15.63:0/3256844249 wait complete. 2024-09-17T04:26:03.818 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T04:26:03.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T04:26:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/802237774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0d0003a50 msgr2=0x7fa0d0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 --2- 172.21.15.63:0/802237774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0d0003a50 0x7fa0d0003ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009b20 tx=0x7fa0d0005830 comp rx=0 tx=0).stop 2024-09-17T04:26:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/802237774 shutdown_connections 2024-09-17T04:26:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 --2- 172.21.15.63:0/802237774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0d0003a50 0x7fa0d0003ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/802237774 >> 172.21.15.63:0/802237774 conn(0x7fa0e40ced50 msgr2=0x7fa0e40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/802237774 shutdown_connections 2024-09-17T04:26:03.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.939+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/802237774 wait complete. 2024-09-17T04:26:03.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.941+0000 7fa0e8ccc640 1 Processor -- start 2024-09-17T04:26:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.941+0000 7fa0e8ccc640 1 -- start start 2024-09-17T04:26:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d0003a50 0x7fa0e414b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 0x7fa0e40b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0e4154730 0x7fa0e40b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4160a00 con 0x7fa0e41f74e0 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40d2000 con 0x7fa0d0003a50 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0e8ccc640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e4160b80 con 0x7fa0e4154730 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0dbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 0x7fa0e40b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0dbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 0x7fa0e40b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33604/0 (socket says 172.21.15.63:33604) 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.942+0000 7fa0dbfff640 1 -- 172.21.15.63:0/147963598 learned_addr learned my addr 172.21.15.63:0/147963598 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0e259c640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d0003a50 0x7fa0e414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0e2d9d640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0e4154730 0x7fa0e40b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 -- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0e4154730 msgr2=0x7fa0e40b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0e4154730 0x7fa0e40b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 -- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d0003a50 msgr2=0x7fa0e414b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fa0d0003a50 0x7fa0e414b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e4155ce0 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0e2d9d640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fa0e4154730 0x7fa0e40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0dbfff640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 0x7fa0e40b2980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0066b0 tx=0x7fa0cc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00f7e0 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0cc016020 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00fc40 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e4155fc0 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.943+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e40cadf0 con 0x7fa0e41f74e0 2024-09-17T04:26:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.944+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0e4156200 con 0x7fa0e41f74e0 2024-09-17T04:26:03.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.945+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0cc011430 con 0x7fa0e41f74e0 2024-09-17T04:26:03.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.945+0000 7fa0daffd640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa0c4078b90 0x7fa0c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fa0cc09b4e0 con 0x7fa0e41f74e0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0e259c640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa0c4078b90 0x7fa0c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0daffd640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa0c407eaa0 0x7fa0c4080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0cc00ce90 con 0x7fa0c407eaa0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa0cc0a2050 con 0x7fa0e41f74e0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0e2d9d640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa0c407eaa0 0x7fa0c4080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0e259c640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa0c4078b90 0x7fa0c407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4035000 tx=0x7fa0d402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.946+0000 7fa0e2d9d640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa0c407eaa0 0x7fa0c4080ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:03.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.947+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== osd.7 v2:172.21.15.112:6818/843462089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0cc00ce90 con 0x7fa0c407eaa0 2024-09-17T04:26:03.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.960+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 --> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa0e40714a0 con 0x7fa0c407eaa0 2024-09-17T04:26:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.960+0000 7fa0daffd640 1 -- 172.21.15.63:0/147963598 <== osd.7 v2:172.21.15.112:6818/843462089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa0e40714a0 con 0x7fa0c407eaa0 2024-09-17T04:26:03.961 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-17T04:26:03.962 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T04:26:03.962 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-17T04:26:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa0c407eaa0 msgr2=0x7fa0c4080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6818/843462089,v1:172.21.15.112:6819/843462089] conn(0x7fa0c407eaa0 0x7fa0c4080ef0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa0c4078b90 msgr2=0x7fa0c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fa0c4078b90 0x7fa0c407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4035000 tx=0x7fa0d402d040 comp rx=0 tx=0).stop 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 msgr2=0x7fa0e40b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 --2- 172.21.15.63:0/147963598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0e41f74e0 0x7fa0e40b2980 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0066b0 tx=0x7fa0cc003a80 comp rx=0 tx=0).stop 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e2d9d640 1 -- 172.21.15.63:0/147963598 reap_dead start 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 shutdown_connections 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 >> 172.21.15.63:0/147963598 conn(0x7fa0e40ced50 msgr2=0x7fa0e40d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 shutdown_connections 2024-09-17T04:26:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:03.961+0000 7fa0e8ccc640 1 -- 172.21.15.63:0/147963598 wait complete. 2024-09-17T04:26:03.973 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T04:26:04.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 -- 172.21.15.63:0/2990744058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a8155ce0 msgr2=0x7ff1a80708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 --2- 172.21.15.63:0/2990744058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a8155ce0 0x7ff1a80708b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff1a806eeb0 tx=0x7ff1a002aa30 comp rx=0 tx=0).stop 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 -- 172.21.15.63:0/2990744058 shutdown_connections 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 --2- 172.21.15.63:0/2990744058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a8155ce0 0x7ff1a80708b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 --2- 172.21.15.63:0/2990744058 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a815c580 0x7ff1a8070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 --2- 172.21.15.63:0/2990744058 >> v2:172.21.15.112:3300/0 conn(0x7ff1a8074420 0x7ff1a806fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 -- 172.21.15.63:0/2990744058 >> 172.21.15.63:0/2990744058 conn(0x7ff1a806def0 msgr2=0x7ff1a806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 -- 172.21.15.63:0/2990744058 shutdown_connections 2024-09-17T04:26:04.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.089+0000 7ff1adda1640 1 -- 172.21.15.63:0/2990744058 wait complete. 2024-09-17T04:26:04.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.091+0000 7ff1adda1640 1 Processor -- start 2024-09-17T04:26:04.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.091+0000 7ff1adda1640 1 -- start start 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1a8074420 0x7ff1a8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a8155ce0 0x7ff1a814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a815f9b0 con 0x7ff1a814e8c0 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a815f830 con 0x7ff1a8074420 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1adda1640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a815fb30 con 0x7ff1a8155ce0 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33624/0 (socket says 172.21.15.63:33624) 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 -- 172.21.15.63:0/459328097 learned_addr learned my addr 172.21.15.63:0/459328097 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a77fe640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1a8074420 0x7ff1a8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a6ffd640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a8155ce0 0x7ff1a814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 -- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a8155ce0 msgr2=0x7ff1a814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a8155ce0 0x7ff1a814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 -- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1a8074420 msgr2=0x7ff1a8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1a8074420 0x7ff1a8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 -- 172.21.15.63:0/459328097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a8156e70 con 0x7ff1a814e8c0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.093+0000 7ff1a7fff640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1a002b020 tx=0x7ff1a0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.094+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0033050 con 0x7ff1a814e8c0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.094+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1a0004450 con 0x7ff1a814e8c0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.094+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a815b260 con 0x7ff1a814e8c0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.094+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0038450 con 0x7ff1a814e8c0 2024-09-17T04:26:04.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.094+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a8157150 con 0x7ff1a814e8c0 2024-09-17T04:26:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.095+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a815c580 con 0x7ff1a814e8c0 2024-09-17T04:26:04.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.095+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1a0036070 con 0x7ff1a814e8c0 2024-09-17T04:26:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.096+0000 7ff18ffff640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 0x7ff19407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.096+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff1a00bbca0 con 0x7ff1a814e8c0 2024-09-17T04:26:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.096+0000 7ff1a77fe640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 0x7ff19407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.097+0000 7ff1a77fe640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 0x7ff19407b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff198005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:04.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.100+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff1a0083e30 con 0x7ff1a814e8c0 2024-09-17T04:26:04.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.285+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff1a8156c20 con 0x7ff194078b90 2024-09-17T04:26:04.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.285+0000 7ff18ffff640 1 -- 172.21.15.63:0/459328097 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff1a8156c20 con 0x7ff194078b90 2024-09-17T04:26:04.286 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.287+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 msgr2=0x7ff19407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.287+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 0x7ff19407b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff198009ab0 tx=0x7ff198005f90 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.287+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 msgr2=0x7ff1a81524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1a002b020 tx=0x7ff1a0003f90 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 shutdown_connections 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7ff194078b90 0x7ff19407b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1a814e8c0 0x7ff1a81524b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7ff1a8155ce0 0x7ff1a814e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 --2- 172.21.15.63:0/459328097 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7ff1a8074420 0x7ff1a8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 >> 172.21.15.63:0/459328097 conn(0x7ff1a806def0 msgr2=0x7ff1a81e6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 shutdown_connections 2024-09-17T04:26:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.288+0000 7ff1adda1640 1 -- 172.21.15.63:0/459328097 wait complete. 2024-09-17T04:26:04.300 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:26:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 -- 172.21.15.63:0/784530805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc8003a00 msgr2=0x7f0bc8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 --2- 172.21.15.63:0/784530805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0bc8003a00 0x7f0bc8003e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009b20 tx=0x7f0bc8005830 comp rx=0 tx=0).stop 2024-09-17T04:26:04.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be4c5a640 1 -- 172.21.15.63:0/784530805 reap_dead start 2024-09-17T04:26:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 -- 172.21.15.63:0/784530805 shutdown_connections 2024-09-17T04:26:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 -- 172.21.15.63:0/784530805 >> 172.21.15.63:0/784530805 conn(0x7f0be00cdc60 msgr2=0x7f0be00ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 -- 172.21.15.63:0/784530805 shutdown_connections 2024-09-17T04:26:04.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.417+0000 7f0be66bd640 1 -- 172.21.15.63:0/784530805 wait complete. 2024-09-17T04:26:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.419+0000 7f0be66bd640 1 Processor -- start 2024-09-17T04:26:04.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.419+0000 7f0be66bd640 1 -- start start 2024-09-17T04:26:04.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc8003a00 0x7f0be01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0be015af00 0x7f0be0153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0be00d0060 con 0x7f0be015aaf0 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f0be00d01e0 con 0x7f0bc8003a00 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f0be00d0360 con 0x7f0be015af00 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33650/0 (socket says 172.21.15.63:33650) 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 -- 172.21.15.63:0/3043280298 learned_addr learned my addr 172.21.15.63:0/3043280298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdffff640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc8003a00 0x7f0be01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be4c5a640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0be015af00 0x7f0be0153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 -- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0be015af00 msgr2=0x7f0be0153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0be015af00 0x7f0be0153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 -- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc8003a00 msgr2=0x7f0be01588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc8003a00 0x7f0be01588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 -- 172.21.15.63:0/3043280298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be0157e10 con 0x7f0be015aaf0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdf7fe640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4005f60 tx=0x7f0bd400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401e070 con 0x7f0be015aaf0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd400e7c0 con 0x7f0be015aaf0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be015a080 con 0x7f0be015aaf0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.421+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400ebf0 con 0x7f0be015aaf0 2024-09-17T04:26:04.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.422+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be0158390 con 0x7f0be015aaf0 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.423+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be0159df0 con 0x7f0be015aaf0 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.423+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bd4021070 con 0x7f0be015aaf0 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.424+0000 7f0bdcff9640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 0x7f0bcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.424+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f0bd409b7e0 con 0x7f0be015aaf0 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.424+0000 7f0bdffff640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 0x7f0bcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:04.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.425+0000 7f0bdffff640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 0x7f0bcc07b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009b20 tx=0x7f0bd002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:04.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.428+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bd400fe60 con 0x7f0be015aaf0 2024-09-17T04:26:04.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.609+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0be00ccfa0 con 0x7f0bcc078b90 2024-09-17T04:26:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.610+0000 7f0bdcff9640 1 -- 172.21.15.63:0/3043280298 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13337 (secure 0 0 0) 0x7f0be00ccfa0 con 0x7f0bcc078b90 2024-09-17T04:26:04.611 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:26:04.611 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:26:04.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 msgr2=0x7f0bcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 0x7f0bcc07b0a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009b20 tx=0x7f0bd002d040 comp rx=0 tx=0).stop 2024-09-17T04:26:04.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 msgr2=0x7f0be00c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4005f60 tx=0x7f0bd400f790 comp rx=0 tx=0).stop 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 shutdown_connections 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f0bcc078b90 0x7f0bcc07b0a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f0be015af00 0x7f0be0153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0be015aaf0 0x7f0be00c6080 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 --2- 172.21.15.63:0/3043280298 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f0bc8003a00 0x7f0be01588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.612+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 >> 172.21.15.63:0/3043280298 conn(0x7f0be00cdc60 msgr2=0x7f0be015d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.613+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 shutdown_connections 2024-09-17T04:26:04.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:04.613+0000 7f0be66bd640 1 -- 172.21.15.63:0/3043280298 wait complete. 2024-09-17T04:26:04.624 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-17T04:26:04.442609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":228828,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745892,"statfs":{"total":773094113280,"available":772859793408,"internally_reserved":0,"allocated":4366336,"data_stored":2409440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.188725"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":138,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T04:25:56.623502+0000","last_change":"2024-09-17T04:23:14.460811+0000","last_active":"2024-09-17T04:25:56.623502+0000","last_peered":"2024-09-17T04:25:56.623502+0000","last_clean":"2024-09-17T04:25:56.623502+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:25:56.623502+0000","last_undegraded":"2024-09-17T04:25:56.623502+0000","last_fullsized":"2024-09-17T04:25:56.623502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T04:23:13.213009+0000","last_clean_scrub_stamp":"2024-09-17T04:23:13.213009+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:49.190212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":991232,"data_stored":743956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":991232,"data_stored":743956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:26:04.627 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T04:23:13.213009+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=23, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=4, tm_min=25, tm_sec=59, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T04:26:04.627 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T04:26:21.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:21.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:24.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T04:26:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 -- 172.21.15.63:0/736759889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240ccba0 msgr2=0x7fd4240ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 --2- 172.21.15.63:0/736759889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240ccba0 0x7fd4240ccfb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd4240709b0 tx=0x7fd41c02aa10 comp rx=0 tx=0).stop 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 -- 172.21.15.63:0/736759889 shutdown_connections 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 --2- 172.21.15.63:0/736759889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240ccba0 0x7fd4240ccfb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 --2- 172.21.15.63:0/736759889 >> v2:172.21.15.112:3300/0 conn(0x7fd42415c6f0 0x7fd4240ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 --2- 172.21.15.63:0/736759889 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240d1d40 0x7fd4240b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 -- 172.21.15.63:0/736759889 >> 172.21.15.63:0/736759889 conn(0x7fd4240b3f10 msgr2=0x7fd4240b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 -- 172.21.15.63:0/736759889 shutdown_connections 2024-09-17T04:26:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.763+0000 7fd42ad62640 1 -- 172.21.15.63:0/736759889 wait complete. 2024-09-17T04:26:24.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.765+0000 7fd42ad62640 1 Processor -- start 2024-09-17T04:26:24.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.765+0000 7fd42ad62640 1 -- start start 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 0x7fd4240b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd42415c6f0 0x7fd4241f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240d11f0 con 0x7fd4240d1d40 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240d1070 con 0x7fd42415c6f0 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd42ad62640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240d1370 con 0x7fd4240ccba0 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58518/0 (socket says 172.21.15.63:58518) 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 -- 172.21.15.63:0/1711568681 learned_addr learned my addr 172.21.15.63:0/1711568681 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd428afe640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 0x7fd4240b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd4292ff640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd42415c6f0 0x7fd4241f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 -- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 msgr2=0x7fd4240b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 0x7fd4240b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 -- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd42415c6f0 msgr2=0x7fd4241f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd42415c6f0 0x7fd4241f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 -- 172.21.15.63:0/1711568681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4240b1530 con 0x7fd4240d1d40 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd428afe640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 0x7fd4240b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.767+0000 7fd423fff640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c940 tx=0x7fd41800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.768+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418007bb0 con 0x7fd4240d1d40 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.768+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd418007e40 con 0x7fd4240d1d40 2024-09-17T04:26:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.768+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41800f6b0 con 0x7fd4240d1d40 2024-09-17T04:26:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.768+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42414dbc0 con 0x7fd4240d1d40 2024-09-17T04:26:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.768+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42414e180 con 0x7fd4240d1d40 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.769+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4240d1900 con 0x7fd4240d1d40 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.770+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd41800f850 con 0x7fd4240d1d40 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.770+0000 7fd4217fa640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 0x7fd41007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.770+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd41809b0a0 con 0x7fd4240d1d40 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.770+0000 7fd428afe640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 0x7fd41007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.771+0000 7fd428afe640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 0x7fd41007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd414005940 tx=0x7fd414005e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:24.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.775+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd418014030 con 0x7fd4240d1d40 2024-09-17T04:26:24.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.958+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 --> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4240b1a80 con 0x7fd410078bc0 2024-09-17T04:26:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.959+0000 7fd4217fa640 1 -- 172.21.15.63:0/1711568681 <== mgr.4100 v2:172.21.15.112:6800/915738559 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7fd4240b1a80 con 0x7fd410078bc0 2024-09-17T04:26:24.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:26:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 msgr2=0x7fd41007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 0x7fd41007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd414005940 tx=0x7fd414005e30 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 msgr2=0x7fd4241f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c940 tx=0x7fd41800ce00 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 shutdown_connections 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fd410078bc0 0x7fd41007b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fd42415c6f0 0x7fd4241f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4240d1d40 0x7fd4241f6a40 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 --2- 172.21.15.63:0/1711568681 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fd4240ccba0 0x7fd4240b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 >> 172.21.15.63:0/1711568681 conn(0x7fd4240b3f10 msgr2=0x7fd4240b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 shutdown_connections 2024-09-17T04:26:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:24.962+0000 7fd42ad62640 1 -- 172.21.15.63:0/1711568681 wait complete. 2024-09-17T04:26:24.973 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-17T04:26:24.447304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":228812,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745908,"statfs":{"total":773094113280,"available":772859809792,"internally_reserved":0,"allocated":4366336,"data_stored":2409440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"1.0","version":"35'74","reported_seq":148,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T04:26:04.366387+0000","last_change":"2024-09-17T04:26:04.366387+0000","last_active":"2024-09-17T04:26:04.366387+0000","last_peered":"2024-09-17T04:26:04.366387+0000","last_clean":"2024-09-17T04:26:04.366387+0000","last_became_active":"2024-09-17T04:23:14.459466+0000","last_became_peered":"2024-09-17T04:23:14.459466+0000","last_unstale":"2024-09-17T04:26:04.366387+0000","last_undegraded":"2024-09-17T04:26:04.366387+0000","last_fullsized":"2024-09-17T04:26:04.366387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'74","last_scrub_stamp":"2024-09-17T04:26:04.366268+0000","last_deep_scrub":"35'74","last_deep_scrub_stamp":"2024-09-17T04:26:04.366268+0000","last_clean_scrub_stamp":"2024-09-17T04:26:04.366268+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:19.163874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":743956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":743956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T04:26:24.974 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 -- 172.21.15.63:0/804555584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf0b0 msgr2=0x7f31880d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 --2- 172.21.15.63:0/804555584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf0b0 0x7f31880d4510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3178009830 tx=0x7f317802a480 comp rx=0 tx=0).stop 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 -- 172.21.15.63:0/804555584 shutdown_connections 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 --2- 172.21.15.63:0/804555584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf0b0 0x7f31880d4510 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 --2- 172.21.15.63:0/804555584 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 0x7f31880b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 -- 172.21.15.63:0/804555584 >> 172.21.15.63:0/804555584 conn(0x7f318808bfc0 msgr2=0x7f318809d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 -- 172.21.15.63:0/804555584 shutdown_connections 2024-09-17T04:26:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.091+0000 7f318f789640 1 -- 172.21.15.63:0/804555584 wait complete. 2024-09-17T04:26:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.093+0000 7f318f789640 1 Processor -- start 2024-09-17T04:26:25.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.093+0000 7f318f789640 1 -- start start 2024-09-17T04:26:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31880cf0b0 0x7f31880cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 0x7f318814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f31880d2bb0 con 0x7f31880cf4c0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7f31880d4d50 con 0x7f31880cf0b0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318f789640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7f31880d2d30 con 0x7f31880d0ce0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318cd24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318cd24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58530/0 (socket says 172.21.15.63:58530) 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.094+0000 7f318cd24640 1 -- 172.21.15.63:0/11418509 learned_addr learned my addr 172.21.15.63:0/11418509 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318d525640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31880cf0b0 0x7f31880cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318dd26640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 0x7f318814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 -- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 msgr2=0x7f318814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 0x7f318814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 -- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31880cf0b0 msgr2=0x7f31880cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31880cf0b0 0x7f31880cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 -- 172.21.15.63:0/11418509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31880ccb30 con 0x7f31880cf4c0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318cd24640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f317802aa70 tx=0x7f3178033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178031d60 con 0x7f31880cf4c0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3178033e10 con 0x7f31880cf4c0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178005260 con 0x7f31880cf4c0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31880cce10 con 0x7f31880cf4c0 2024-09-17T04:26:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.095+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31880cd3d0 con 0x7f31880cf4c0 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.096+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31880cc8a0 con 0x7f31880cf4c0 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.097+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3178005400 con 0x7f31880cf4c0 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.098+0000 7f317dffb640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.098+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f31780bbc30 con 0x7f31880cf4c0 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.098+0000 7f318d525640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.099+0000 7f318d525640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 0x7f316c07b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3184005fd0 tx=0x7f318400a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.102+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f317803f030 con 0x7f31880cf4c0 2024-09-17T04:26:25.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.289+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3188051080 con 0x7f31880cf4c0 2024-09-17T04:26:25.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.292+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7f3188051080 con 0x7f31880cf4c0 2024-09-17T04:26:25.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.293+0000 7f317dffb640 1 -- 172.21.15.63:0/11418509 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f31780056f0 con 0x7f31880cf4c0 2024-09-17T04:26:25.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 msgr2=0x7f316c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 0x7f316c07b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3184005fd0 tx=0x7f318400a250 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 msgr2=0x7f31881f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f317802aa70 tx=0x7f3178033c20 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 shutdown_connections 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7f31880d0ce0 0x7f318814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31880cf4c0 0x7f31881f5920 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 --2- 172.21.15.63:0/11418509 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7f31880cf0b0 0x7f31880cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 >> 172.21.15.63:0/11418509 conn(0x7f318808bfc0 msgr2=0x7f318806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 shutdown_connections 2024-09-17T04:26:25.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.295+0000 7f318f789640 1 -- 172.21.15.63:0/11418509 wait complete. 2024-09-17T04:26:25.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T04:26:25.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T04:26:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 -- 172.21.15.63:0/2818173058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe740b66b0 msgr2=0x7fbe740b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/2818173058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe740b66b0 0x7fbe740b3710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbe7408d760 tx=0x7fbe6802a5f0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 -- 172.21.15.63:0/2818173058 shutdown_connections 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/2818173058 >> v2:172.21.15.112:3300/0 conn(0x7fbe7406e0e0 0x7fbe7406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/2818173058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe740b66b0 0x7fbe740b3710 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 -- 172.21.15.63:0/2818173058 >> 172.21.15.63:0/2818173058 conn(0x7fbe7409d7f0 msgr2=0x7fbe740d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 -- 172.21.15.63:0/2818173058 shutdown_connections 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.423+0000 7fbe7b55e640 1 -- 172.21.15.63:0/2818173058 wait complete. 2024-09-17T04:26:25.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.425+0000 7fbe7b55e640 1 Processor -- start 2024-09-17T04:26:25.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.425+0000 7fbe7b55e640 1 -- start start 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 --2- >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe740b9970 0x7fbe740b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 --2- >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe740ca8f0 0x7fbe740b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7406ea30 con 0x7fbe7406e0e0 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 -- --> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740d5010 con 0x7fbe740ca8f0 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe7b55e640 1 -- --> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] -- mon_getmap magic: 0 -- 0x7fbe7406ebb0 con 0x7fbe740b9970 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe792fa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe792fa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58548/0 (socket says 172.21.15.63:58548) 2024-09-17T04:26:25.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.426+0000 7fbe792fa640 1 -- 172.21.15.63:0/3978672857 learned_addr learned my addr 172.21.15.63:0/3978672857 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 -- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe740b9970 msgr2=0x7fbe740b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe740b9970 0x7fbe740b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 -- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe740ca8f0 msgr2=0x7fbe740b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe740ca8f0 0x7fbe740b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 -- 172.21.15.63:0/3978672857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7415ca40 con 0x7fbe7406e0e0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe792fa640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c390 tx=0x7fbe6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c017070 con 0x7fbe7406e0e0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbe6c0035f0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c003a40 con 0x7fbe7406e0e0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7415cce0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.427+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe74155220 con 0x7fbe7406e0e0 2024-09-17T04:26:25.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.428+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe740c7cb0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.429+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe6c01a070 con 0x7fbe7406e0e0 2024-09-17T04:26:25.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.430+0000 7fbe71ffb640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 0x7fbe6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T04:26:25.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.430+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbe6c099dd0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.430+0000 7fbe78af9640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 0x7fbe6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T04:26:25.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.431+0000 7fbe78af9640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 0x7fbe6007b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe68033000 tx=0x7fbe68000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T04:26:25.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.434+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe740c7cb0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.661+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe7406f9b0 con 0x7fbe7406e0e0 2024-09-17T04:26:25.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.661+0000 7fbe71ffb640 1 -- 172.21.15.63:0/3978672857 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3914 (secure 0 0 0) 0x7fbe6c09bf60 con 0x7fbe7406e0e0 2024-09-17T04:26:25.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-17T04:26:25.661 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":19,"btime":"2024-09-17T04:25:54:242852+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6837/801577375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6836","nonce":801577375},{"type":"v1","addr":"172.21.15.112:6837","nonce":801577375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/3701823482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3701823482},{"type":"v1","addr":"172.21.15.63:6835","nonce":3701823482}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.112:6835/1968481792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6834","nonce":1968481792},{"type":"v1","addr":"172.21.15.112:6835","nonce":1968481792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4277596385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4277596385},{"type":"v1","addr":"172.21.15.63:6834","nonce":4277596385}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-17T04:26:25.662 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 19 2024-09-17T04:26:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.663+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 msgr2=0x7fbe6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.663+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 0x7fbe6007b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe68033000 tx=0x7fbe68000bc0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.663+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 msgr2=0x7fbe74154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T04:26:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.663+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c390 tx=0x7fbe6c00c850 comp rx=0 tx=0).stop 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 shutdown_connections 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:6800/915738559,v1:172.21.15.112:6801/915738559] conn(0x7fbe60078b90 0x7fbe6007b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] conn(0x7fbe740ca8f0 0x7fbe740b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] conn(0x7fbe740b9970 0x7fbe740b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 --2- 172.21.15.63:0/3978672857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe7406e0e0 0x7fbe74154ce0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 >> 172.21.15.63:0/3978672857 conn(0x7fbe7409d7f0 msgr2=0x7fbe740ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 shutdown_connections 2024-09-17T04:26:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-17T04:26:25.664+0000 7fbe7b55e640 1 -- 172.21.15.63:0/3978672857 wait complete. 2024-09-17T04:26:25.674 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T04:26:25.675 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T04:26:25.675 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T04:26:25.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.688 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T04:26:25.688 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T04:26:25.688 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.739 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T04:26:25.739 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T04:26:25.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.751 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T04:26:25.751 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T04:26:25.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.804 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T04:26:25.804 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T04:26:25.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T04:26:25.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.833 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T04:26:25.833 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T04:26:25.833 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.909 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T04:26:25.909 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T04:26:25.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:25.974 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T04:26:25.974 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T04:26:25.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.042 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T04:26:26.042 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T04:26:26.042 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.075 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T04:26:26.075 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T04:26:26.075 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.144 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T04:26:26.144 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T04:26:26.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.226 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T04:26:26.226 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T04:26:26.226 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.300 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T04:26:26.301 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T04:26:26.301 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T04:26:26.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.328 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T04:26:26.329 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T04:26:26.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.372 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T04:26:26.373 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T04:26:26.373 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T04:26:26.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.384 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T04:26:26.385 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T04:26:26.385 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.426 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T04:26:26.427 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T04:26:26.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T04:26:26.480 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T04:26:26.480 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T04:26:26.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T04:26:26.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:26:26.517 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T04:26:26.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:26:26.713 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T04:26:26.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:26:26.825 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T04:26:26.875 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:26:26.875 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T04:26:26.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:26:26.926 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T04:26:27.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:26:27.082 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T04:26:27.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:26:27.162 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T04:26:27.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:26:27.212 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T04:26:27.261 INFO:tasks.ceph:Archiving mon data... 2024-09-17T04:26:27.262 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/data/mon.a.tgz 2024-09-17T04:26:27.262 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-17T04:26:27.278 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.1mr9vk6yZP 2024-09-17T04:26:27.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1mr9vk6yZP 2024-09-17T04:26:27.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.1mr9vk6yZP 2024-09-17T04:26:27.493 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.1mr9vk6yZP is 304KB 2024-09-17T04:26:27.589 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.1mr9vk6yZP 2024-09-17T04:26:27.605 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/data/mon.b.tgz 2024-09-17T04:26:27.605 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-17T04:26:27.621 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.u2q0A2tjDc 2024-09-17T04:26:27.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.u2q0A2tjDc 2024-09-17T04:26:27.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.u2q0A2tjDc 2024-09-17T04:26:27.858 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.u2q0A2tjDc is 411KB 2024-09-17T04:26:27.930 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.u2q0A2tjDc 2024-09-17T04:26:27.945 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/data/mon.c.tgz 2024-09-17T04:26:27.945 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-17T04:26:27.999 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.itwhvALoml 2024-09-17T04:26:28.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.itwhvALoml 2024-09-17T04:26:28.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.itwhvALoml 2024-09-17T04:26:28.221 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.itwhvALoml is 411KB 2024-09-17T04:26:28.288 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.itwhvALoml 2024-09-17T04:26:28.307 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T04:26:28.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T04:26:28.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T04:26:28.391 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T04:26:28.425 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T04:26:28.425 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T04:26:28.426 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi063/crash 2024-09-17T04:26:28.427 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T04:26:28.458 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi112/crash 2024-09-17T04:26:28.459 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T04:26:28.488 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T04:26:28.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:28.503 DEBUG:teuthology.orchestra.run.smithi112:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:28.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:28.610 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T04:26:28.634 INFO:tasks.ceph:Compressing logs... 2024-09-17T04:26:28.634 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:26:28.652 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T04:26:28.675 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T04:26:28.723 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36822.log 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42962.log 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5/var/log/ceph/ceph-client.admin.36822.log: --verbose -- /var/log/ceph/ceph-client.admin.36902.log 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.3.42962.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36822.log.gz 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42962.log.gz 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37022.log 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36902.log.gz 2024-09-17T04:26:28.724 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37022.log: /var/log/ceph/ceph-mds.b.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37022.log.gz 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36982.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36942.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36982.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36982.log.gz 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36942.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36942.log.gz 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42966.log 2024-09-17T04:26:28.725 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.3.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42566.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42966.log.gz 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.42566.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42566.log.gz 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-osd.5.log: 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mds.d.log: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42561.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.x.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37062.log 2024-09-17T04:26:28.726 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.1.42561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42561.log.gz 2024-09-17T04:26:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-09-17T04:26:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37062.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37062.log.gz 2024-09-17T04:26:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T04:26:28.727 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37102.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46047.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104855.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36756.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46047.log.gz 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36421.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36756.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104855.log.gz 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36756.log.gz 2024-09-17T04:26:28.761 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46338.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.36421.log.gz 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46338.log.gz 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105863.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz/var/log/ceph/ceph-client.admin.46131.log: 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105863.log.gz 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 2024-09-17T04:26:28.762 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz/var/log/ceph/ceph-client.admin.36824.log: 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104771.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46715.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104771.log.gz 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103825.log 2024-09-17T04:26:28.763 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105947.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46715.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.103825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45221.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103825.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105611.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105947.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.45221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45221.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105611.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43908.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105611.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45658.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43227.log 2024-09-17T04:26:28.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.2.45658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45658.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104585.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43227.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105485.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104492.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104585.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42691.log: /var/log/ceph/ceph-client.admin.105485.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105485.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104492.log: /var/log/ceph/ceph-client.admin.47435.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104492.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104958.log 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2024-09-17T04:26:28.765 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105042.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36551.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36882.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104958.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47998.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105042.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105042.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105359.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36882.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47998.log: /var/log/ceph/ceph-client.admin.105359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103812.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105359.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105653.log 2024-09-17T04:26:28.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47956.log: /var/log/ceph/ceph-client.admin.103812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43101.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103812.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37196.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105653.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36792.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37196.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36792.log: /var/log/ceph/ceph-client.admin.46428.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36792.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-09-17T04:26:28.767 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43059.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104627.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105737.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43059.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46005.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104627.log: /var/log/ceph/ceph-client.admin.105737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106269.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104627.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.105737.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105989.log 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46005.log.gz 2024-09-17T04:26:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106269.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105779.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105989.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.105989.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36364.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105779.log: /var/log/ceph/ceph-client.admin.36364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36853.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36364.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105779.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43904.log: /var/log/ceph/ceph-client.admin.36853.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2024-09-17T04:26:28.769 INFO:teuthology.orchestra.run.smithi063.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36853.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105317.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46757.log: /var/log/ceph/ceph-client.admin.42392.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43185.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105317.log: /var/log/ceph/ceph-client.admin.43185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44236.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105317.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43185.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47140.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44236.log.gz 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-09-17T04:26:28.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104897.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104897.log: /var/log/ceph/ceph-client.admin.43912.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104897.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43269.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44877.log: /var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36449.log 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43269.log.gz 2024-09-17T04:26:28.771 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43647.log: /var/log/ceph/ceph-client.admin.36449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.36449.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105275.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46883.log: /var/log/ceph/ceph-client.admin.105275.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36252.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105275.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47393.log: /var/log/ceph/ceph-client.admin.36252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2024-09-17T04:26:28.772 INFO:teuthology.orchestra.run.smithi063.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.36252.log.gz 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104729.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gz 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47788.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104729.log: /var/log/ceph/ceph-client.admin.47788.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.104729.log.gz -5 2024-09-17T04:26:28.773 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47788.log.gz 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105569.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz -- 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.47309.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44655.log: /var/log/ceph/ceph-client.admin.105569.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz -5 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105569.log.gz 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105905.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44245.log: /var/log/ceph/ceph-client.admin.43913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68475.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106227.log 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-09-17T04:26:28.774 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.68475.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105905.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43437.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68475.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106227.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106227.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43437.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105443.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44739.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-09-17T04:26:28.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45963.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105443.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48252.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45963.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46631.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43015.log: /var/log/ceph/ceph-client.0.48252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43911.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48252.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105000.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46631.log.gz/var/log/ceph/ceph-client.admin.43911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-09-17T04:26:28.776 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43911.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.105000.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36754.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105000.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43563.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105084.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48256.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36881.log 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4%/var/log/ceph/ceph-client.0.48256.log: -- replaced with /var/log/ceph/ceph-client.admin.105084.log.gz 2024-09-17T04:26:28.777 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48256.log.gzgzip 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105401.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36881.log: /var/log/ceph/ceph-client.admin.105401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5%/var/log/ceph/ceph-client.admin.47746.log: -- replaced with /var/log/ceph/ceph-client.admin.105401.log.gz 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36881.log.gz 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36572.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47267.log: gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.43909.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36572.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2024-09-17T04:26:28.778 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43903.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36336.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6%/var/log/ceph/ceph-client.admin.43903.log: -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43903.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36336.log: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.36336.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46505.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44571.log: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105527.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106115.log 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46505.log: /var/log/ceph/ceph-client.admin.105527.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46505.log.gz 2024-09-17T04:26:28.779 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37236.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105527.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106115.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.106115.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45879.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105821.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37236.log: /var/log/ceph/ceph-client.admin.45879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr: 86.5% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45879.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37236.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45837.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.105821.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45837.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-09-17T04:26:28.780 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106031.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45837.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45921.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43311.log: /var/log/ceph/ceph-client.admin.106031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47658.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45921.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106031.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45921.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47658.log: -- /var/log/ceph/ceph-client.admin.42971.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36392.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47658.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104813.log 2024-09-17T04:26:28.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44249.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42971.log: /var/log/ceph/ceph-client.admin.104813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47098.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44249.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104813.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44249.log.gzgzip 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47098.log: -- /var/log/ceph/ceph-client.admin.44487.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47098.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44487.log: /var/log/ceph/ceph-client.admin.46934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36883.log 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47704.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2024-09-17T04:26:28.782 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36883.log: gzip -5 85.4% -- replaced with /var/log/ceph/ceph-client.admin.36883.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44241.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.105695.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103741.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.105695.log: /var/log/ceph/ceph-client.admin.103741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106187.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103741.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37437.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105695.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-09-17T04:26:28.783 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106187.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106187.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: 2.9% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44529.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.104669.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43689.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43353.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.104669.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104669.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.45354.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43353.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43353.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph.tmp-client.admin.30197.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45354.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.44247.log 2024-09-17T04:26:28.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.30197.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30197.log.gz 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45216.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.45216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45216.log.gz 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz/var/log/ceph/ceph-client.admin.44613.log: 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46673.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46260.log: /var/log/ceph/ceph-client.admin.36694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36877.log 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46673.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-09-17T04:26:28.785 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46673.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46799.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: 86.5%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36877.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43605.log: /var/log/ceph/ceph-client.admin.46799.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46799.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.46589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106073.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5%/var/log/ceph/ceph-client.admin.37525.log: -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T04:26:28.786 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.106073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68432.log 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.106073.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45662.log 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.68432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68432.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.2.45662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45662.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43143.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47225.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.b.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T04:26:28.787 INFO:teuthology.orchestra.run.smithi112.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T04:26:28.809 INFO:teuthology.orchestra.run.smithi063.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T04:26:28.832 INFO:teuthology.orchestra.run.smithi112.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T04:26:28.834 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T04:26:28.847 INFO:teuthology.orchestra.run.smithi063.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T04:26:28.857 INFO:teuthology.orchestra.run.smithi112.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T04:26:28.861 INFO:teuthology.orchestra.run.smithi063.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T04:26:28.873 INFO:teuthology.orchestra.run.smithi112.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T04:26:28.874 INFO:teuthology.orchestra.run.smithi112.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T04:26:28.890 INFO:teuthology.orchestra.run.smithi112.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T04:26:28.892 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-17T04:26:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.197s 2024-09-17T04:26:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m0.981s 2024-09-17T04:26:28.892 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.058s 2024-09-17T04:26:28.899 INFO:teuthology.orchestra.run.smithi063.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T04:26:28.943 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T04:26:29.022 INFO:teuthology.orchestra.run.smithi063.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T04:26:29.024 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-17T04:26:29.024 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.359s 2024-09-17T04:26:29.024 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m1.214s 2024-09-17T04:26:29.024 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.151s 2024-09-17T04:26:29.024 INFO:tasks.ceph:Archiving logs... 2024-09-17T04:26:29.025 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi063/log 2024-09-17T04:26:29.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:26:29.364 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi112/log 2024-09-17T04:26:29.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T04:26:29.539 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T04:26:29.559 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T04:26:29.559 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:26:29.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T04:26:29.633 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T04:26:29.643 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T04:26:29.643 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:26:29.646 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T04:26:29.658 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:26:29.660 INFO:teuthology.orchestra.run.smithi112.stderr:bash: line 1: ntpq: command not found 2024-09-17T04:26:29.662 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:26:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-17T04:26:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +1610us[+1606us] +/- 51ms 2024-09-17T04:26:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +184us[ +184us] +/- 66ms 2024-09-17T04:26:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -2800us[-2800us] +/- 79ms 2024-09-17T04:26:29.663 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:26:29.664 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T04:26:29.664 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-09-17T04:26:29.665 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +1615us[+1610us] +/- 51ms 2024-09-17T04:26:29.665 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 +199us[ +199us] +/- 66ms 2024-09-17T04:26:29.665 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -2791us[-2791us] +/- 79ms 2024-09-17T04:26:29.665 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T04:26:29.665 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T04:26:29.673 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T04:26:29.673 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T04:26:29.682 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:26:29.774 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T04:26:29.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:26:29.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:26:29.867 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T04:26:29.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:26:29.894 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T04:26:29.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T04:26:29.940 INFO:teuthology.task.internal:Duration was 585.913785 seconds 2024-09-17T04:26:29.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T04:26:29.949 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T04:26:29.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:26:29.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T04:26:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:26:29.989 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T04:26:30.353 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T04:26:30.353 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-17T04:26:30.353 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:26:30.413 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-17T04:26:30.414 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T04:26:30.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T04:26:30.445 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:26:30.456 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T04:26:30.512 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T04:26:30.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:26:30.524 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T04:26:30.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T04:26:30.663 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T04:26:30.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:26:30.689 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T04:26:30.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T04:26:30.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:26:30.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:26:30.753 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-17T04:26:30.778 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-17T04:26:30.791 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:26:30.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:26:30.823 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T04:26:30.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T04:26:30.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T04:26:30.856 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T04:26:30.856 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi063 2024-09-17T04:26:30.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:26:30.898 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908525/remote/smithi112 2024-09-17T04:26:30.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T04:26:30.932 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T04:26:30.932 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:26:30.936 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T04:26:30.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T04:26:30.993 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T04:26:30.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T04:26:31.004 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T04:26:31.004 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:26:31.006 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T04:26:31.020 INFO:teuthology.orchestra.run.smithi063.stdout: 266064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 04:26 /home/ubuntu/cephtest 2024-09-17T04:26:31.037 INFO:teuthology.orchestra.run.smithi112.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 04:26 /home/ubuntu/cephtest 2024-09-17T04:26:31.039 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T04:26:31.052 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T04:26:31.078 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/acls} duration: 585.9137852191925 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T04:26:31.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T04:26:31.164 INFO:teuthology.run:pass